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PREFACE 



This report presents findings about accountability from two longitudinal studies, the National 
Longitudinal Study of No Chi/d Left Behind (NLS-ATCLB), and the Study of State Implementation of 
Accountability and Teacher Quality Under No Child Left Behind (SSI-NCLB). The research teams for 
these two studies have collaborated to provide an integrated evaluation of the implementation of key 
NCLB provisions at the state level (SSI-NCLB) and at the district and school levels (NLS-NCLB). 
Together the two studies are the basis for a series of reports on the topics of accountability, teacher 
quality, Title I school choice and supplemental educational services, and targeting and resource 
allocation. 

This is the ninth and last volume in this report series. The other eight volumes were: 

Volume I — Title I School Choice, Supplemental Educational Services, and Student Achievement 
Volume II — Teacher Quality Under NCLB: Interim Report 
Volume III — Accountability Under NCLB: Interim Report 

Volume IV — Title I School Choice and Supplemental Educational Services: Interim Report 
Volume V — Implementation of the 1 Percent Rule and 2 Percent Interim Policy Options 
Volume VI — Targeting and Uses of Federal Education Funds 

Volume VII — Title I School Choice and Supplemental Educational Services: Final Report 
Volume VIII — Teacher Quality Under NCLB: Final Report 
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EXECUTIVE SUMMARY 



The No Child L eft Rehind Act of 2001 ( NCLB ) is designed to achieve an ambitious goal: All children will be 
proficient in reading and mathematics by the 201 3— 14 school year. A key strategy for achieving this goal is 
accountability. NCLB holds schools and districts accountable for their students’ mastery of state 
academic content standards, as measured by state tests, including students with limited English 
proficiency (LEP) and students receiving special education services. NCLB accountability rests on 
several key premises: that clear definitions and targets for desired academic outcomes and English 
language proficiency will provide both incentives for and indicators of improvement; that identification 
of districts and schools not meeting their improvement targets will help focus assistance and 
interventions in places where they are most needed; that widely available information about student 
performance will enable parents, educators and other stakeholders to make informed decisions about 
how best to serve their students or children; and that targeted assistance will stimulate school and district 
improvement. 

Based on findings from two federally funded studies — the Study of State Implementation of 
Accountability and Teacher Quality Under NCLB ( SSI-NCLB ) and the National Longitudinal Study of 
NCLB (NhS-NCLB) — this report describes the progress that states, districts, and schools have made in 
implementing the accountability provisions of NCLB through 2006—07. Data were collected in state- 
level interviews; surveys of a nationally representative sample of district officials, principals, and teachers; 
surveys of parents in eight school districts; and surveys of supplemental educational service providers in 
16 districts in 2004—05 and in 2006—07. This report is based on data collected in 2004—05 and 2006—07, 
and updates findings from the Interim report that were based on data collected in 2004—05. 

Focus of the Report 

This report presents findings from the SSI -NCLB and NLS-IVCLB on state-, district-, and school-level 
implementation of the accountability provisions of NCLB. It addresses questions in six areas: 

• How have states implemented the standards, assessment, and accountability provisions of 
Title I? 

• How are schools and districts performing with respect to making adequate yearly progress 
(AYP)? What are the reasons why schools do not make AYP? Are there common 
characteristics among districts and schools identified for improvement? 

• How have states implemented the English language proficiency standards, assessment, and 
accountability provisions of Titles I and III? 

• How is information about NCLB, AYP, and identification for improvement communicated to 
stakeholders, and how well do district and school staff understand the status of their districts and 
schools? 

• In what ways do states support improvements in district and school performance? 

• What efforts are being made to improve district and school performance, including technical 
assistance, mandated interventions, and local initiatives? 
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Key Findings 



States used the flexibility provided by NCUi to establish accountability systems that varied in terms of 
the rigor of their academic standards, the level at which they set proficiency, the type of assessments they 
use, and the manner in which they calculated AYP and set their annual proficiency targets. As a result of 
these differences as well as differences in student achievement, there was a large variation across states in 
the percentage of schools missing AYP and being identified for improvement. For example, the 
proportion of schools that made AYP in 2005—06 ranged from less than 30 percent in two states to 
90 percent or more in five states. 

Overall, three-quarters of the nation’s schools made AYP in 2005—06, a nearly identical proportion as in 
2003—04 and 2004—05. In fact, four-fifths of schools had the same AYP designation from one year to 
the next. Sixty- five percent of schools made AYP in both years, and 16 percent missed AYP in both 
years. Ten percent of schools’ designations worsened (i.e., moved from making AYP in 2004—05 to 
missing AYP in 2005—06) and 9 percent of schools’ designations improved. 

Among the 27 percent of schools that did not make AYP in 2005—06, more than half (55 percent) did 
not succeed because the school as a whole (i.e., the “all students” group) or multiple student subgroups 
did not meet academic achievement standards. One-quarter of schools that did not make AYP met all 
targets except for the achievement of a single subgroup. More than one-half of the schools that missed 
for a single subgroup missed targets solely for the students with disabilities subgroup (this represents 14 
percent of schools that did not make AYP). 

Overall, 20 percent of Title I schools (10,781 schools) were identified for improvement for 2006—07. 
After a large increase between 2003—04 and 2004—05, the percentage of Tide I schools identified for 
improvement increased more gradually between 2005—06 and 2006—07. Nearly three-fourths of the 
identified schools at the beginning of 2004—05 remained in improvement status two years later in 
2006—07 and nearly half were in corrective action or restructuring. Furthermore, there has been a 
decline over time in the proportion of identified Tide I schools exiting improvement status, from 
23 percent in 2004—05 to 12 percent in 2006—07. 

Although only 13 percent of Title I districts (1,728) were identified for improvement for 2006—07, these 
districts enrolled 40 percent of the nation’s students, or about 1 8 million students. The number of 
districts identified for improvement for 2006—07 was similar to the previous year, but the number of 
districts identified for corrective action increased five-fold. 

Nearly all states had implemented English language proficiency (ELP) standards and assessments by 
2006—07. Over one-half of the states were applying accountability actions to districts that had not met 
their Annual Measurable Achievement Objectives (AMAOs) for consecutive years, but many states were 
not yet imposing required consequences due to the extended time needed for standards and assessment 
development and to recent changes in the assessments used to measure progress. 

All states reported having a system of support for schools identified for improvement, and most states 
(40) reported providing some level of support to all identified schools. Forty-seven states had systems of 
support for districts in 2006—07, 28 of which were implemented between 2004—05 and 2006—07. States 
reported challenges associated with meeting the needs of increased numbers of schools identified for 
improvement and identifying interventions that have been proven to improve the performance of non- 
proficient students. 
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Nearly all schools reported making multiple improvement efforts in 2006—07, including improving 
curriculum and instruction, increasing the use of assessment results for planning, and increasing the 
amount of instruction in reading and mathematics for low-performing students. Most schools also 
reported receiving technical assistance that met their needs. However, about one-third of schools 
needing assistance to improve services to students with disabilities and about one-half of schools needing 
assistance to address the instructional needs of limited English proficient students did not have these 
needs fully met. 

Required interventions occurred in most Title I schools in Year 1 or Year 2 of identification or in 
corrective action in 2006—07. However, many Title I schools in restructuring status did not experience 
any of the four specific interventions named in the law (although it is possible they may have 
experienced another type of restructuring option). More than one-half of Title I districts in corrective 
action reported receiving none of the eight interventions specified in the law. 

Other Findings 

State standards, assessments, and targets 

In 2006-07, all states had met NCLB requirements for content standards and were making progress 
toward meeting NCLB requirements for assessments of all students in all required grades. 

In 2006-07, all states had content standards in reading, mathematics and science, 
but many continued to revise their standards or adopt new standards. 

By 2003, all states had received federal approval for the process through which they developed reading 
and mathematics content standards for the grade spans required under the Improving America’s Schools Act 
of 1994 (L4SAJ. By 2007, all states, the District of Columbia, and Puerto Rico had submitted evidence to 
the U.S. Department of Education that they had approved science content standards. In 2006 and 2007, 
about one state in five was in the process of revising content standards for reading (13 states), 
mathematics (13 states), or science (13 states). 

As of 2006-07, 37 states, the District of Columbia, and Puerto Rico had developed 
entirely new tests or modified existing assessments in grades 3-8 to comply with 
NCLB. 

Complying with NCLB testing requirements has necessitated substantial test development by states. 
While 14 states kept their existing tests to meet the requirements of NCLB, the majority developed or 
modified reading and mathematics tests specifically for NCLB: 1 6 states indicated they had developed all 
new assessments in reading and mathematics in grades 3—8, and 21 were able to retain some existing tests 
or modify existing tests. 

By 2005-06, all states had alternate assessments based on alternate academic 
achievement standards (AA-AAAS) in place for students with the most significant 
cognitive disabilities, but the U.S. Department of Education’s peer review process 
found that 38 states’ AA-AAAS did not adequately meet requirements. By January 
2009, 13 states’ AA-AAAS did not adequately meet requirements. 

Students with disabilities typically participate in proficiency assessments in one of two ways: participation 
in the general assessment (with or without accommodations) for the majority of students with 
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disabilities, or participation in an AA-AAAS. In 2006—07, all states, the District of Columbia, and Puerto 
Rico allowed testing accommodations to enable students with disabilities to take the general state 
assessments and had AA-AAAS in place for use with students with the most significant cognitive 
disabilities. 

The variation in states’ AYP starting points— and thus in how much progress a state 
must demonstrate by 2014— is strongly related to how high the states set their 
academic achievement standards for proficiency. 

States that set higher performance standards tend to have a lower percentage of students scoring at the 
proficient level and must therefore make greater progress in student achievement by 2013—14. Put 
simply, states with higher standards are likely to face more challenges in reaching 1 00 percent 
proficiency. 

Meeting adequate yearly progress targets: results from evolving 
systems 

Stable national rates of making AYP from 2003-04 to 2005-06 mask the fact that 
some states’ rates of making AYP rose substantially while others’ rates fell 
substantially. 

Seven states’ proportions of schools that made AYP rose by more than 10 percent while 15 states’ 
proportions dropped by more than 10 percent from 2003-04 to 2005-06. In five states, 90 percent or 
more of schools made AYP, while less than 30 percent of schools made AYP in two states. This 
variability across states may be due to variation in performance or variation in states’ implementation of 
NCLB accountability requirements. 

Most African-American, Hispanic and white students, and most students from 
low-income families, attended schools in which AYP was calculated for their 
respective subgroup because the minimum number or percent of students required 
to constitute a subgroup was met. 

At least 83 percent or more of all African-American, Hispanic, and white students, as well as students 
from low-income families, attended schools where AYP was calculated for these subgroups in 2005—06 
because the minimum number or percent of students needed to constitute a subgroup was met. 
American Indian students and Asian students often did not have school-level AYP calculated for their 
subgroup, due to a small number of such students in the school, but were included in AYP 
determinations for the school as a whole. 

Identifying schools and districts for improvement 

The majority of identified Title I schools were concentrated in just over 1 percent of 
the nation’s Title I districts. 

With four-fifths of districts containing no identified schools and most of the rest containing only one or 
two identified schools, most identified Title I schools were concentrated in a small number of districts. 
Over half (53 percent) of all Title I schools identified for improvement were located in the 177 districts 
that each had 10 or more identified schools in 2006—07. 
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Title I schools in the more advanced stages of improvement status were more likely 
to have missed AYP for the achievement of “all students” or for two or more 
subgroups than other Title I schools. 

Specifically, 80 percent of Title I schools identified for corrective action and restructuring for 2006—07 
did not make AYP for the “all students” group or for two or more subgroups (based on 2005—06 
assessments). In comparison, 59 percent of Title I schools that were identified for improvement for the 
first year and 42 percent of Title I schools that did not make AYP but were not identified for 
improvement did not make AYP for the “all students” group or for two or more subgroups. 

Ensuring progress for students with limited English proficiency: 

Title III accountability 

States have been moving forward in their development and implementation of their Title III provisions, 
and have dedicated considerable effort toward putting statewide processes in place for meeting the needs 
ofLEP students. 

By 2006-07, nearly all states reported that they had implemented ELP assessments 
aligned with state ELP standards; almost half the states developed their ELP 
assessments in collaboration with a multi-state consortium. 

Before NCUi, few states used assessments that were appropriate for measuring progress in acquiring 
English language proficiency. At the start of 2004—05, implementation of ELP assessments aligned with 
state ELP standards was incomplete in over half (27) of the states. Forty-four states, the District of 
Columbia, and Puerto Rico implemented their assessments during or after 2004—05. 

By 2006-07, 12 states had finalized their AMAO targets, while over half were in the 
process of revising them. 

In 2006—07, 26 states and the District of Columbia were revising their AMAOs, while only 12 had 
finalized these targets. Thirty-seven states still anticipated amending their AMAOs. 

Providing information about school performance to stakeholders 

States reported performance results from 2005-06 testing more quickly than from 
2003-04 testing. 

For example, 44 states, the District of Columbia, and Puerto Rico reported that schools identified for 
improvement received preliminary notification of their accountability status before September 2006, an 
increase from 31 states in 2003—04. While the improved timeliness represents an encouraging 
development, roughly one-third of states were still finalizing calculations and processing appeals well into 
the school year. 

States have made progress since 2004-05 in developing student data systems to 
measure the progress of individual students. 

Although not mandated by NCLB, the capacity to track the progress of individual students helps 
instructional and policy decisions. In 2006—07, 41 states had data systems with unique student identifiers 
and could track students across years, up from 32 states in 2005—06 and 16 in 2004—05. 
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Nearly all principals knew whether their schools made AYP (90 percent) or were 
identified for improvement (94 percent) in 2006-07. 

More teachers 1 knew whether their schools made AYP or were identified for improvement in 2006—07 
than in 2004—05, but teachers remained less knowledgeable about their schools’ status than principals. 

School improvement 

NCLB requires states to establish support systems to help schools and districts that are identified for 
improvement. 

In 2006-07, 40 states had tiered systems of support, compared to 18 in 2004-05. 

In a tiered system of support, the intensity and focus of support varies as schools progress to more 
severe accountability levels. In 2006—07, states were also more likely than in 2004—05 to delegate the 
responsibility for supporting schools to other levels of government (e.g., county, regional entities, 
districts), with a particular emphasis on districts providing support to schools. 

Both identified and non-identified schools reported needing technical assistance in 
many areas in 2005-06 or 2006-07, but the need was greater among identified 
schools. 

In most areas, principals of schools identified for improvement reported receiving the technical 
assistance they needed and reported that it met their needs. On average, identified schools reported 
receiving about eight days of technical assistance, compared with four days for non-identified schools. 
However, according to principals, one-third of the schools that needed technical assistance to improve 
services to students with disabilities did not have their needs fully met. In addition, one-half of schools 
needing technical assistance to improve services for limited English proficient students did not have their 
needs fully met. 

Improving curriculum and instruction was a major focus of school improvement in 
both identified and non-identified schools, and almost all teachers had access to 
materials to align curriculum with standards. 

Two-thirds of all schools reported placing a major emphasis in their improvement efforts on aligning 
curriculum and instruction with state standards, and about one-half placed a major emphasis on 
improving instructional approaches or improving curriculum in reading and mathematics. In addition, 
almost all teachers reported using state test results to improve student learning, and about two-thirds of 
schools reported using periodic progress assessments, as well. 



1 Data reported from the NLS-NCLB sample represent national estimates for districts and schools. Data reported on 
teachers are representative of the teachers sampled — elementary classroom teachers, secondary English teachers, and 
secondary teachers of mathematics. For simplicity, this report uses the term “all teachers” to refer to this sample. The 
study also surveyed a sample of special education teachers (both elementary and secondary) and data for these teachers 
are reported separately. 
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Almost three-quarters of schools offered extended-time instructional programs in 
2006-07, which served a small, but increasing, percentage of students. 



Schools identified for improvement were more likely to offer extended-time programs than non- 
identified schools. In addition to extended-time programs, some schools reallocated time during the 
school day to provide more instruction in reading and mathematics. On average, third-grade teachers 
reported that students spent about 20 minutes more per week in reading and about 1 0 minutes more per 
week in mathematics in 2006—07 than in 2004—05, although the time they reported devoting to other 
subjects remained virtually unchanged. 

District improvement 

In 2006-07, most states continued to provide a broad range of technical assistance 
to all districts. 

Compared to 2004—05, more states reported providing assistance for parent involvement activities and to 
support the needs of LEP students. In states that provided technical assistance specifically to districts 
identified for improvement, the most common type of technical assistance was developing and 
implementing district improvement plans (23 states), aligning professional development with the 
districts’ high-need areas (17 states), and analyzing budgets to align spending with improvement priorities 
(11 states). 

In 2006-07, three-quarters of districts reported receiving the technical assistance 
they needed in most areas and reported that the assistance met their needs. 

However, district officials reported that technical assistance was not always sufficient to meet district 
needs relating to LEP students, students with disabilities, and professional development for schools that 
did not make AYP. 

Implications for Future Policy 

Overall, the findings presented in this report paint a picture of considerable activity and rapid 
implementation of NCLJi requirements. The findings also identify areas in which limited 
implementation and information present challenges to achieving the goal of proficiency for every student 
in reading and mathematics by 2014. 

• The numbers and percentages of identified schools and districts varied considerably across 
states, in part due to differences in state standards, assessments, and AYP targets. 

• The increasing number of schools identified for improvement and the proportion of identified 
schools that are moving into corrective action and restructuring present challenges to state and 
district support systems. 

• Little is known about the quality of local improvement efforts or the effectiveness of state and 
district technical assistance and interventions. 

In summary, states, districts, and schools have engaged in a high level of activity and have largely met the 
iVCLB accountability system requirements through 2006—07, but states and districts have reported 
challenges associated with meeting the needs of increased numbers of schools identified for 
improvement and identifying interventions that have been proven to improve the performance of non- 
proficient students. 
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I. INTRODUCTION 



The No Child Left Behind Act of 2001 ( NCLB ) establishes an ambitious goal for the nation’s states, 
districts, and schools: all children will he proficient in reading and mathematics by the 2013—14 schoolyear. The 
federal strategy for achieving this goal is multifaceted but at its heart lies a set of performance-based 
accountability provisions that build on and expand those of its predecessor law, the Improving America’s 
Schools Act of 1994 ( IAS A ). Both NCEB and IAS A are reauthorizations of the most comprehensive 
federal legislation in K— 12 education, the Elementary and Secondary Education Act of 1965 (ESEA). The 
main performance accountability requirements of ESE4 are based on the principle that all children 
should “have a fair, equal, and significant opportunity to obtain a high quality education” (Sec. 1001) and 
are contained in two titles of the act: 

• Title I outlines the standards, assessment, and accountability requirements intended to guide the 
instruction of all students in the core academic subjects of reading, 2 mathematics, and science. 

• Title III adds provisions to ensure that students with limited English proficiency (LEP) gain the 
English language skills they need to meet the state standards and be successful in school. 

This report describes trends in the ways in which states, districts, and schools are implementing the 
standards, assessment and accountability provisions of Titles I and III and analyzes the progress the 
nation is making toward the goal of proficiency for all students. It is based on data collected through 
two federally funded studies, the Study of State Implementation of Accountability and Teacher Quality 
Under No Child Eeft Behind (SSI-NCEB), and the National Longitudinal Study of No Child Eeft Behind 
(NLS-NCLB). Data were collected in state-level interviews; surveys of a nationally representative sample 
of district officials, principals, and teachers; surveys of parents in eight school districts; and surveys of 
supplemental educational service providers in 16 districts in 2004—05 and in 2006—07. Companion 
reports, also based on these studies, address NCEB implementation and progress in the areas of teacher 
quality, Title I school choice and supplemental educational services, and targeting and resource allocation 
under Title I and certain other federal education programs. 

Overview of Accountability Provisions of NCLB 

Like other performance-based accountability systems, NCEB accountability rests on several key 
premises: (1) clear definitions and targets for desired outcomes — in this case, high academic achievement 
for all students — will provide both incentives and indicators for improvement; (2) identification of 
districts and schools not meeting their improvement targets will help focus assistance and interventions 
where they are needed most; (3) widely available information about performance will enable parents, 
educators, and other stakeholders to make appropriate decisions about how best to serve their students; 
and (4) targeted assistance and consequences will stimulate school and district improvement. 

These premises are not new with NCEB, but NCEB alters or expands their parameters in significant 
ways. Accountability for school performance has been included as a component of ESEA since the 
1988 reauthorization. The IAS A first established a comprehensive academic standards-based approach 
to school improvement and school accountability in federal statute. Building on the IASA, NCEB 
includes requirements to: 



2 For simplicity, the term “reading” is used throughout this report to refer to the set of subjects that may be variously 
known as reading, English, or language arts. 
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• develop a system of standards, assessments that align to the standards, and accountability 
measures based on achievement of the standards that applies to all public schools and local 
education agencies (IASA only required that the system be applied to students served under 
Tide I); 

• identify schools and districts that need improvement, based on the performance of all students 
as well as the performance of designated subgroups of students (under IASA, there was no 
required disaggregation by subgroups); 

• provide useful information about school performance to stakeholders; and 

• provide appropriate assistance and require interventions to stimulate school and district 
improvement. 

NCLB accountability strategies are shown in Exhibit 1, and each set of requirements is further described 
below. 



Exhibit 1 

NCLB Strategies to Reach 100 Percent Student Proficiency 




Source: No Child heft Behind Act of 2001 , Public Law 107-1 10-Jan 8, 2002. 



Develop a standards-based system of measures and targets 

Prior to NCLB, LAS A required states to develop and implement challenging content standards, 
specifying what students should know and be able to do, in reading and mathematics and to administer 
assessments aligned with those standards at least once in each of three grade spans: grades 3—5, 6—9, and 
10—12. Although LAS A contemplated that a state would have a standards-based system that applied to 
all students, if the state did not, IASA only required that standards and assessments be developed for 
students participating in Title I programs. Building on LASA, NCLB: 
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• requires either statewide grade-level content standards or statewide specific grade-level expectations instead 
of content standards only for broad grade spans, as in L4SA. 3 

• increases the assessment requirements to include annual testing of all students in grades 3—8 and 
testing of all students once during high school, in reading and mathematics. To meet this 
requirement, states were required to develop or adopt assessments for the previously untested 
grades by 2005—06. As with IASs 1, the state assessments must be aligned with state academic 
content standards; however, IASA only required assessment of students participating in Title I 
programs. 

• requires states to develop or adopt science content standards by 2005—06 and to implement science 
assessments in the three grade spans by 2007—08. L4SA did not require standards or assessments 
in science. 

• adds a requirement that states must develop or adopt standards for English language proficiency (ELP) 
for students with limited English proficiency (LEP) by 2002—03 and annually assess progress of 
all LEP students toward these standards. 

NCLB also builds on the L4SA requirement to determine whether a school or school district makes 
adequate yearly progress (AYP). Under L4SA, states set targets for schools and school districts that 
demonstrated “continuous and substantial yearly improvement. . .sufficient to achieve the goal of all 
Title I students meeting the State’s proficient and advanced levels of performance on the assessments 
aligned with state standards.” iVCEB continues the AYP requirement but modifies and expands its 
specifications. 

• iVCEB requires a state to measure AYP for each public elementary and secondary school and 
public school district in the state based on the achievement of all public school students. L4SA 
only required that a state measure AYP for Title I schools based only on students participating in 
Title I. 

• iVCEB mandates a uniform timeframe for demonstrating progress of all students toward meeting a 
state’s proficient standards. While initial starting points may vary by state, AYP targets in every 
state must reflect the goal of all students performing at proficient levels in reading and 
mathematics by 2013—14. IASA had no such timeframe. 

• iVCEB requires that AYP be measured relative to an absolute target (percentage of students at or 
above proficiency in reading and mathematics). IASA did not specify the form of the target but 
instead left it up to the states. 

• To make AYP, schools and districts must assess 95 percent of students overall and of each relevant 
subgroup. 

• To make AYP, districts and schools must also meet annual measurable objectives (AMOs) for every 
key subgroup (major racial and ethnic groups, low-income students, students with disabilities, and 
LEP students) as well as for the district or school as a whole. The participation and subgroup 
criteria are a centerpiece of IVCEB and are included to help ensure that districts and schools are 
held accountable for meeting the needs of all of their students, not just the majority group. 

L4SA included neither assessment participation criteria nor subgroup targets. 



3 States may elect to add expectations to their existing standards delineating which of the standards students should 
know and be able to meet at the end of each grade and to what level of performance. 
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• NCEB requires states to include an “other academic indicator” in definitions of AYP, in addition to 
proficiency and participation targets on state assessments. 4 L4SA allowed for but did not 
require additional indicators. 

• NCEB (Tide III) requires states to establish English language proficiency targets (called “annual 
measurable achievement objectives”) to demonstrate progress of LEP students in learning 
English, attaining English proficiency, and making AYP for performance in the content areas of 
reading and mathematics. 

Identify schools and districts that need improvement 

Establishing standards, assessments, and annual targets is only the first step in performance-based 
accountability. Equally important is the use of these measures to identify schools and districts that need 
to improve. For interventions and assistance to be appropriately targeted, the accountability system 
must reliably and validly determine which schools and districts did not make AYP targets and which 
require improvement. While identification of Title I schools for improvement predated L4SA, the 1994 
ESEL4 statute tied this identification to the failure of Title I schools or districts to make state-established 
AYP performance targets. Thus, under L4SA, Tide I schools and districts that did not make AYP for 
two consecutive years were identified for improvement, and schools that failed for three more years were 
to receive “corrective actions” from the district. To exit the “identified for improvement” designation, a 
school or district had to make AYP for two out of three years following identification. NCEB 
maintained the initial “identified for improvement” criteria (not making AYP for two consecutive years) 
but changed the exit criteria (making AYP for two consecutive years), and altered the stages and timeline 
in significant ways. 

• Under NCEB, there are five stages of identification (as compared with two under L4S A). These 
are: Identified for Improvement Year 1, Identified for Improvement Year 2, Corrective Action, 
Restructuring planning, and Restructuring implementation. 

• The criteria and timeline for advancing to a more intensive stage of the improvement process are 
dependent on whether the school did not make AYP for an additional year, not on the absolute 
number of years the school is in a given stage. The resulting timeline is as follows: After a 
school does not make AYP for two consecutive years, it is identified for improvement (Year 1). 
Each time it does not make AYP for an additional year, the school moves into another stage of 
identification and intervention. Year 2 improvement schools have not made AYP for three (not 
necessarily consecutive) years. A fourth year of failure to make AYP targets places the school in 
“corrective action” status; the fifth year of missing AYP places the school in “restructuring 
planning” status; and the sixth year of missing AYP places the school in “restructuring 
implementation” status (see Exhibit 2). 



4 The state must select one “other academic indicator” to be used for AYP calculations for each level of schooling. For 
high schools, the other indicator must be graduation rate. For elementary and middle schools, states have the flexibility 
to choose their own indicators (see Chapter If). 
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Exhibit 2 

Stages of Identification for School Improvement 



School 
misses AYP 
for two 
consecutive 
years 



Identified for 
Improvement 
Year 1 

Interventions: 



Offer school 
choice 
+ 

Develop 

improvement 

plan 

+ 

Notify parents 
+ 

Allocate 1 0% 
funds for PD 
+ 

Technical 
assistance from 
district 



School misses 
AYP for — 
additional year 



Identified for 
Improvement 
Year 2 

Addtional 

Intervention 

Supplemental 

educational 

services 



School misses 
AYP for — 
additional year 



Corrective Action 
Status 

Additional 

Interventions*: 

One or more of: 

Implement 
research-based 
curriculum or 
instructional program 
-or- 

Decrease school's 
management authority 
-or- 

Extend school day or 
school year 
-or- 

Restructure school's 
organization 
-or- 

Replace staff relevant 
to school's low 
performance 
-or- 

Appomt an outside 
w expert 



School misses 
AYP for — 
additional year 



Restructuring 

Status 



Additional 

Interventions*: 

Phase 1: Develop 

restructuring plan 

Phase 2: One or 
more of: 

Reopen school as 
charter 
-or- 

Replace all or most 
staff 
-or- 

Contract with 
another entity 
-or- 

State takeover of 
school 
-or- 

Other major 
governance 
restructuring 



School exits school improvement, corrective action, or restructuring status if it makes AYP 
for two consecutive years, but it retains its status if it only makes AYP for one year 



Provide useful information about school performance to stakeholders 

A central assumption of performance-based accountability is that, when educators, administrators, 
parents, and other stakeholders have information about the performance of schools and districts, they 
will be able to make informed decisions about resources and actions that are in the best interest of 
students. For this assumption to hold, stakeholders must have access to accurate, reliable, and valid 
information about the requirements and options specified in the law, about student performance, and 
about resources and practices likely to result in improved student achievement. NCLB requires states to 
produce and distribute report cards that include information on AYP, improvement status, and student 
achievement. It also adds the following requirements: 

• Public dissemination of disaggregated achievement data and the percentage of classes taught by 
highly qualified teachers. 
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• The information on student and school performance must be made available to schools, 
districts, and parents in a timely fashion so that parents may take advantage of the school choice 
and supplemental educational services options and schools may take appropriate improvement 
actions by the beginning of the school year. 

Provide appropriate assistance and require interventions to stimulate 
school and district improvement 

The purpose of identifying schools and districts for improvement is to help ensure that appropriate 
actions are taken to foster school progress and provide options to students and parents. NCLJ5 is more 
prescriptive and specific than IASA in the actions that states and districts must take to ensure school 
improvement. 

• NCLB specifies options for parents at each stage of school identification. For a Title I school in 
Year 1 or any subsequent year of identification, the district must offer all parents the option of 
transferring their child to another public, non-identified school Districts must notify parents of their 
choice options before the start of the school year and provide students with transportation to 
non-identified schools. (Under IAS A, Congress added requirements in 1999 and 2000 that 
school choice be offered to students in Title I schools identified for improvement, when 
feasible. However, 1ASA did not require districts to apply this option to all schools identified 
for improvement without regard to structural constraints, such as space available, or to provide 
transportation.) 

• For Title I schools beginning in Year 2 of improvement status, districts must also offer students 
from low-income families the option of receiving supplemental educational services from a state-approved 
provider. 

• For schools in corrective action status, districts must implement at least one of six specified 
interventions (replacing staff relevant to the failure to make AYP, implementing a new curriculum, 
decreasing management authority at the site, appointing an outside expert, extending the school 
day or year, or restructuring the school’s internal organization). 

• After not making AYP targets for five years, the school must plan to restructure its governance and, 
the next year, must restructure by either closing the school and reopening it as a charter school, 
replacing all or most of the school staff, turning management over to the state or a private 
agency or some other major form of restructuring (see Exhibit 2). 

• iVCLB also identifies specific support mechanisms for schools identified for improvement, including 
technical assistance, school support teams, and distinguished teachers and principals to assist in 
planning and improvement efforts. States are also required to provide support to districts 
identified for improvement, including assistance in developing an improvement plan and 
strategies to work more effectively with schools identified for improvement, and addressing 
potential challenges related to parent involvement or professional development. Although 
1ASA specified some state strategies, NCUB emphasizes the development of state support 
systems. NCLB also requires districts to assist schools in analyzing data from state assessments, 
identifying proven effective strategies for professional development and instruction, and revising 
school budgets to allocate resources more effectively. Schools identified for improvement under 
NCLB must spend 10 percent of their allocation of Title I, Part A, funds for the purpose of 
providing professional development that addresses the reasons the school was identified for 
improvement. 1ASA also included many of the same strategies to support school improvement. 
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To document the ways in which they would comply with the accountability requirements of NCNB, 
states were required to submit initial accountability plans (often referred to as “accountability 
workbooks”) to the U.S. Department of Education by January 2003. These plans were approved 
through a peer review process in spring 2003. 5 Since then, states have had the option of submitting 
annual amendments to their accountability plans. These amendments require approval by the U.S. 
Department of Education. 

Evaluation Questions and Findings From Interim Report 

This final report is based on data collected through the 2006—07 school year and addresses six broad 
questions relevant to the NCLB accountability provisions outlined above. 

• How have states implemented the standards, assessment, and accountability provisions of 
Title I? (See Chapter II.) 

• How are schools and districts performing with respect to making AYP? What are the reasons 
that schools do not make AYP? Are there common characteristics among districts and schools 
identified for improvement? (See Chapters III and IV.) 

• How have states implemented the English language proficiency standards, assessment, and 
accountability provisions of Title III? (See Chapter V.) 

• How is information about NCLB, AYP, and identification for improvement communicated to 
stakeholders, and how well do district and school staff understand the status of their districts and 
schools? (See Chapter VI.) 

• In what ways do states support improvements in district and school performance? (See 
Chapters VII and VIII.) 

• What efforts are being made to improve district and school performance, including technical 
assistance, mandated interventions, and local initiatives? (See Chapters VII and VIII.) 

The interim report, issued in October 2007, presented information on NCLB implementation through 
2004-05, and revealed the following patterns: 

Accountability Policies: 

• All states, the District of Columbia, and Puerto Rico had enacted the key accountability 
provisions required by NCNB and had accountability plans approved the U.S. Department of 
Education. 

• Districts and schools had mostly met the relevant NCLB accountability requirements through 
2004-05. 

• More than half of states were testing students in all required grades in reading and mathematics 
in advance of the 2005—06 NCLB deadline. However, 20 states were behind schedule in 
implementing assessments that measure English language proficiency. A similar number of 
states were not able to notify schools of their performance on the statewide assessments before 
the start of the 2004—05 school year. 



5 See Erpenbach, Forte-Fast and Potts (2003) for a description of this process. 
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Adequate Yearly Progress 

• Seventy-five percent of the nation’s schools made AYP in 2003—04. Of the 25 percent that did 
not make AYP, half (51 percent) did not succeed because the school as a whole (i.e., the “all 
students” group) or multiple student subgroups did not meet academic achievement standards. 

• About one-third of schools that did not make AYP did not do so based on the students with 
disabilities or LEP student subgroups. About two-thirds of those schools reported needing 
technical assistance to improve instruction for these subgroups. 

Identification for Improvement and Improvement Efforts 

• Thirteen percent of the nation’s schools were identified for improvement in 2004—05. Those 
schools were most likely to be high-poverty, high-minority, large, urban schools. 

• Nearly all schools reported making multiple improvement efforts. Schools identified for 
improvement focused on more areas of improvement than non-identified schools. Schools also 
reported receiving technical assistance that met their needs, with exceptions in two areas. About 
one-half of schools needing assistance to improve services to students with disabilities and to 
improve services to LEP students did not have these needs met. States and districts were 
implementing the required interventions in schools identified for improvement and corrective 
action, but they were not implementing the required actions in most of the 1,199 schools in 
restructuring. 

Data Sources 

To address the above evaluation questions, this report presents findings from two federally funded 
studies — the Study of State Implementation of Accountability and Teacher Quality Under IVCLB 
(SSI-IVCLB) and the National Longitudinal Study of NCLJi (NLS-IVCLB). 

The SSI-IVCLB examined state implementation of iVCLB in the areas of accountability and teacher 
quality through analysis of school performance data and state documents (including Web sites and 
consolidated applications and reports), and telephone interviews with state officials responsible for 
implementation of the accountability, teacher quality, Tide III, and supplemental educational services 
requirements. Administrators in all 50 states, Puerto Rico, and the District of Columbia were 
interviewed during the fall and winter of 2004—05 and again in 2006—07. 

A national database of the AYP and improvement statuses of all schools in the country was created from 
data provided by state education officials, reporting on the annual Consolidated State Performance 
Reports (CSPRs), and for approximately half of the states in 2005—06 provided by state education 
officials through the Education Data Exchange Network (EDEN). The resulting National AYP and 
Identification Network (NAYPI) database contains over 89,000 schools (including both Tide I and non— 
Title I schools) in 50 states, the District of Columbia, and Puerto Rico. The database contains AYP 
results from 2003—04, 2004—05, and 2005—06 and identification for improvement statuses for 2004—05, 
2005—06, and 2006—07. AYP data for 2006—07 are currendy available at 
www.ed.gov/ nclb/ accountability/ results/ progress/ index.html. 

The NLS-IVCLB assessed the implementation of NCLJi provisions in districts and schools through 
analysis of survey data collected from a nationally representative sample of 300 districts, within which is 
a sample of 1,483 schools (of which 248 were non— Tide I schools), including a mix of elementary, 
middle, and high schools. In each school, six general education teachers were randomly selected to 
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receive surveys: one teacher in each grade 1—6 at the elementary school level and three English teachers 
and three mathematics teachers at the secondary school level. This teacher sample is referred to as “all 
general education teachers” in this report. In addition, one special education teacher was surveyed in 
each school and one paraprofessional was surveyed in each Title I school in the study sample. 6 For 
simplicity, this report uses the term “teachers” to refer to general education teachers as opposed to 
special education teachers, unless otherwise noted. The NLS-iVCLB surveys were administered in 
2004-05 and again in 2006-07. Response rates across all groups surveyed ranged from 82 percent to 96 
percent in 2004-05 and from 84 percent to 99 percent in 2006-07. See Appendix A for further details 
about the study sample and response rates in the two waves of data collection. 

Technical notes 

The following conventions were used when referring to school year in discussions of AYP and 
identification for improvement. Schools or districts are said to make (or not make) AYP in a particular 
year based on test results from that same year. However, schools or districts are said to be identified for 
improvement for a particular year based on test results from the previous year (or years). For example, if 
43 percent of the students at Garden Elementary were proficient on tests taken in spring 2005—06 and 
the state’s AYP target for 2005—06 was 49 percent of students proficient, we would say that Garden 
Elementary did not make AYP in 2005—06. If the school had also not made AYP the previous year 
(2004—05), we would say that Garden Elementary was identified for improvement for 2006— 07. 

This report is primarily descriptive; with few exceptions, we do not have information about the quality of 
the activities and services that are described. 

References to differences between groups or over time that are based on nationally representative 
samples highlight only those differences that are statistically significant at the 0.05 level. The significance 
level, or alpha level, reflects the probability that a difference between groups as large as the one observed 
could arise due to sampling variation, if there were no true difference between groups in the population. 
The significance tests were conducted differently for different comparisons, and details are described in 
Appendix A. 

Analyses of student achievement data on percentages of schools and districts identified for improvement 
and reasons for schools not making AYP were based on the full population of schools as reported by 
each state. 

Any survey or interview findings reported without a specific date are based on information collected in 
the 2006—07 school year. 



6 Special education teachers are those who teach students with disabilities, including any part-time or itinerant special 
education teachers who might share their time with another school. 
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II. STATE STANDARDS, ASSESSMENTS, AND 
ACCOUNTABILITY 

The No Child Left Behind Act of 2001 (NCLB) requires a system of accountability in which every public 
school in the country is held responsible for the academic achievement of all of its students. At the heart 
of this system are state academic content standards that articulate what students should know and be 
able to do at different grade levels, assessments that measure progress toward meeting those standards, 
and annual measureable objectives that all schools and districts are expected to meet. Although all levels 
of the educational system have responsibility for implementing the provisions of the law, states play a 
particularly important role in that they adopt the standards, implement the assessments, define AYP, and 
determine the accountability goals for all schools and districts throughout their jurisdictions. This 
chapter focuses on state policy response to NCLB requirements for standards, assessments, and 
measuring progress, with particular attention to those provisions that represent a change from prior law. 



Key Findings 

• In 2006—07, all states had content standards in reading, mathematics and science, but 
many continued to revise their standards or adopt new standards. 

• As of 2006—07, 37 states, the District of Columbia, and Puerto Rico, had developed 
entirely new tests or modified existing assessments in grades 3—8 to comply with 
NCLB. By 2006—07, all states had alternate assessments for students with disabilities and 
one-third of states had developed entirely new alternate assessments based on alternate 
academic achievement standards. 

• The variation in AYP starting points — and hence in how much progress a state must 
demonstrate by 2014 — is strongly related to how high the states set their academic 
achievement standards for proficiency. 

• In 2006—07, dual federal-state accountability initiatives continued in 27 states. Since 
2004—05, three states eliminated pse-NCLB elements of their state accountability systems, but 
an additional six states developed new initiatives that went beyond NCLB. 



Implementing Standards and Assessments in Reading, Mathematics, and 
Science 

Content standards and aligned assessments have been core elements of the Elementary and Secondary Education 
Act of 1965 ( ESLL4 ) since its 1994 reauthorization as the Improving America’s Schools Act (L4SA). Under 
IASA, Congress required states to establish content standards in one grade in each of three grade spans 
(3—5, 6—9, and 10—12), performance standards and aligned assessments in reading and mathematics for 
students covered by Title I of ESEA. NCEB built on and expanded IASA provisions by requiring 
states to add either grade-level standards or grade-level expectations to the broader grade-span standards, 
to annually administer aligned assessments in each of grades 3—8 and once in high school to all public 
school students, and to add requirements for standards and assessments in science. NCLB also requires 
that 95 percent of students participate in the assessments of reading and mathematics. This test 
participation requirement applies to all public elementary and secondary schools, school districts, and up 
to eight student subgroups within each school and district: five major racial and ethnic groups (African- 
American, American Indian, Asian, Hispanic, and white), economically disadvantaged students, students 
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with disabilities, and students with limited English proficiency (LEP). 7 Students with disabilities and 
LEP students must be provided with accommodations or alternate assessments when appropriate. 

These requirements and changes in the law have generated a great deal of activity in the five years 
between the enactment of NCLB (January 2002) and the final collection of the data for this study 
(2006-07). During this period, states revised existing content standards or adopted new standards in 
reading, mathematics, and science; developed or adopted new assessments in grades or subjects 
previously untested; established their definitions and cut scores 8 for their academic achievement 
standards (e.g., their definitions for basic, proficient, and advanced performance) on statewide tests; 
and revised accountability workbooks to improve reliability of accountability determinations. 

Establishing content standards in reading, mathematics, and science 

Both NCLB and its precursor, IAS A, required states to establish content standards that “specify what 
children are expected to know and be able to do” in reading, mathematics, and (in the case of NCLB) 
science, that “contain coherent and rigorous content” and “encourage the teaching of advanced skills.” 
Under IAS A, states were to have content standards in required grade spans for reading and mathematics 
and to have their standards development process reviewed and approved by the U.S. Department of 
Education. The Department’s review of standard-setting processes began in 1998, and by the time 
NCLB was enacted in 2002, nearly all states had received federal approval for the content standards 
developed under IASA. 

In 2006-07, all states, the District of Columbia, and Puerto Rico had content 
standards in reading, mathematics and science, but many continued to revise their 
standards or adopt new standards. 

By 2003, all states had received federal approval for the process through which they developed reading 
and mathematics content standards in the grade spans required under IASA. By 2007, all states, the 
District of Columbia, and Puerto Rico had submitted science content standards, for which the 
development processes were reviewed and approved by the U.S. Department of Education. Content 
standards were frequendy revised: thirty states and the District of Columbia reported that their content 
standards were updated on a regular schedule, often mandated by the state legislature or state board of 
education. Among these states, standards were typically updated every four to six years. In 2006 and 
2007, about one state in five updated or revised content standards for reading (13 states), mathematics 
(13 states), or science (13 states) (see Exhibit 3). 

Expanding student assessment systems 

Assessment of student achievement relevant to state standards is a central feature of NCLB, as it was of 
L4SA. Measurement of student progress toward achieving state standards forms the basis on which 
districts and schools are held accountable; interventions are determined; and additional options, such as 
school choice and supplemental educational services, are provided. 

All states were required to submit documentation about their assessments for peer review to ensure that 
state assessment systems met federal standards for technical quality, alignment, inclusion, and reporting. 



7 Each state may determine what is a major racial or ethnic group for the state, so some of these may not be considered 
major in some states. 

8 Cut scores are the minimum scores required for students to demonstrate proficiency — or other designated levels of 
achievement — on assessments. 
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To assist states in meeting the requirements for statewide assessments under NCLB, the U.S. 
Department of Education provided nonregulatory guidance that described the requirements and gave 
examples of acceptable and unacceptable evidence of compliance. If states did not meet all the 
requirements, then the peer review teams provided feedback to help states develop comprehensive 
assessment systems that would provide accurate and valid information for holding districts and schools 
accountable for student achievement. 



Exhibit 3 

Year in Which 2006-07 Reading, Mathematics and Science 
Content Standards Were Adopted or Most Recently Revised 
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□ Number of states that adopted or revised 
reading content standards 

□ Number of states that adopted or revised 
mathematics content standards 



■ Number of states that adopted or revised 
science content standards 
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Exhibit reads: Of the state academic content standards for reading, mathematics, and science in effect in 
2006—07, two were developed or most recendy revised in 1996. 

Note: Three states have revised their K-8 standards and their 9-12 standards in different years and these revisions are 
counted separately in the table. As a result, the number of adoptions reported may be greater than 52. 

Source: SSl-NCLB, Accountability Interviews; Consolidated State Performance Reports; and State Education Agency 
(SEA) Web sites (» = 50 states, the District of Columbia, and Puerto Rico). 



As of 2006-07, 37 states and the District of Columbia had developed entirely new 
tests or modified existing assessments in grades 3-8 to comply with NCLB. 

Complying with NCLB testing requirements has necessitated substantial test development by some 
states. While 14 states retained their existing tests to meet the requirements of NCLB, the majority 
developed or modified their reading and mathematics tests specifically for NCLB: 16 states indicated 
they developed all new assessments in reading and mathematics in grades 3—8, and 17 used a 
combination of new, modified, and existing assessments (see Exhibit 4). States reported that 
implementing the additional testing requirements was one of the most substantive challenges they faced 
in the first three years of NCLB. All of the newly adopted tests were either developed specifically to 
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align with state standards or were off-the-shelf tests that had been augmented to align with state 
standards. 



Features of State Assessment 
Systems 

Annual assessments are a central feature 
of NCLB accountability, and scholars 
have asserted that the annual testing 
requirements of NCLB have shaped 
instructional practices and students’ 
academic experiences. 9 Yet relatively few 
national data have been reported on the 
fundamental features of state assessment 
systems. Three important features of 
state assessments that receive attention 
from school stakeholders — policymakers, 
administrators, and researchers — include: 

• the extent to which assessments 
for AYP purposes include a mix 
of multiple choice and open- 
response items; 



Exhibit 4 

State Approaches to Developing Assessments 
in Grades 3-8, Reading and Mathematics, 
in 2006-07 




Number of States 


Reading 


Mathematics 


Kept existing assessments, all 
grades 


14 


14 


Modified existing assessments, 
all grades 


4 


4 


Developed new assessments, 
all grades 


1 6 a 


16 a 


Mix of new, modified, and 
existing assessments 


17 


17 


Exhibit reads: In order to meet the NCLB requirements 
for state assessments in grades 3 though 8 in reading, 14 
states kept existing assessments in all grades. 

a indicates the District of Columbia is included. 

Source: SSl-NCLB, Accountability Interviews {n — 50 states and 
the District of Columbia). 



• the extent to which teachers and 

the public have access to questions on past state assessments; 



• the amount of time students spend taking tests that are required for AYP. 



Each of these features of state assessment systems is described in the sections that follow (see 
Appendix B, Exhibit B.l for approaches in specific states). 



In 2006-07, reading and mathematics tests in 16 states were composed entirely of 
multiple choice items. 10 In the other 35 states, the District of Columbia, and Puerto 
Rico, assessments included a mix of constructed response and multiple choice 
items. 



For reading and mathematics tests in grades three through eight, the number of states that relied entirely 
on multiple choice questions for AYP purposes has remained relatively stable since NCNB was signed 
into law. Some states shifted to multiple choice— only test formats (for example, Mississippi and 
Maryland in 2006-07) to accelerate AYP calculations and the data reporting process. Other states 
(Alabama and Montana) added extended response or short answer questions to their assessments during 
the same time period. 



9 See, for example, Hamilton, 2004; Hamilton and Stecher, 2006; Meier and Wood, 2004; de Vise, 2007, Lamb, 2007. 

10 These results include elementary and middle school reading and mathematics tests for AYP purposes; they do not 
include extended writing tests that do not count for AYP, nor do they include science or social studies tests that are not 
required for AYP. Moreover, some states include short answer or extended response questions for high school but not 
elementary and middle grades. Finally, California is counted as having both types of items although state officials report 
that 99 percent of the items on the reading assessment are multiple choice. 
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Since NCLB, the number of states that release test items to the public increased 
from 29 in 2001-02 to 40 in 2005-06. 



Although not required by law, in 2005—06 most states released at least some of their test items to the 
general public, most often through the state education Web site but also through publications for 
teachers and the press. While four states released over 75 percent of their test items in 2005—06, most 
released a subset of items, generally one full test form. 11 Among the states that did not release items in 
2005—06, four had released items in prior years, and others were planning on phasing in item releases in 
conjunction with a new test being developed. 

Overall, states varied greatiy in terms of the ways in which they released items, the number of items 
released, the materials associated with the items released, the number of grades and subjects for which 
items were released, and the frequency of item releases. For example, Hawaii developed a Web site 
dedicated to item release, in which teachers could select a grade level, content standard, and even subject 
strand, and the system would generate the appropriate test items. New York included released items in 
English but also in Haitian-Creole, Chinese, Korean, and Russian. The Massachusetts Web site included 
a “question of the day” to which the public could respond and immediately see results. Other states, 
however, provided little or no material associated with the test items, posted items for a limited number 
of subjects or grades, or failed to update item releases on an annual or even biannual basis. 

Many states release items in an effort to increase the transparency of their testing systems and the 
instructional utility of assessments. In at least three states, however, item release policies were driven by 
court mandates. 12 After release, test questions are “retired” and are replaced by updated items. From a 
test development perspective, two related factors affect item release: item age and item exposure. Item 
age is detrimental in that item content may become outdated and less familiar to students — for example, 
older items may contain references to typewriters or other outdated technology or past, rather than 
current, events. Older items also may be differentially familiar to some groups of students more than to 
others, increasing the possibility for unintended bias. Item exposure — that is, the extent to which items 
have been used and thus “exposed” to students in a testing situation — is a problem to the extent that 
specific test items become familiar to students or teachers and become the object of explicit test 
preparation. Exposure is more likely to be a concern for certain items that effectively distinguish among 
students at basic, proficient, and advanced levels. Because such items discriminate so well, they are used 
more often in tests and are at greater risk of overexposure (Stocking and Lewis, 1998; Davey and 
Parshall, 1995). 

The amount of time that students spent taking A/CLB-required assessments in 
reading and mathematics averaged between four and six hours annually, depending 
on the grade level. 

The average combined testing time for state reading and mathematics assessments administered for 
NCLJ5 accountability purposes was about five hours, although test duration varied greatly across the 
30 states from which data were available: In fourth-grade mathematics, tests were as short as 50 minutes 
(Idaho) or as long as 270 minutes (in New Hampshire, Rhode Island, and Vermont) (see Appendix B, 
Exhibit B.l). On average, tests that included only multiple choice items tended to be shorter than tests 
that included items that required short answer or extended responses (see Exhibit 5). 



11 The number of test forms in each state varies greatly depending on the number of tested students and test design 
decisions. In Michigan, in 2005—06, for example, the state administered 216 test forms across all grades. 

12 See, for example, ruling from Arizona: http:/ / www.caselaw.lp. findlaw.com/data2/arizonastatecases/appl/cv/ 
cv000284.pdf (accessed August, 2007). 
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These estimates are based on 
testing times listed in states’ 
test administration manuals, 
and do not include other 
activities associated with test- 
taking such as listening to 
instructions, responding to 
sample questions, or breaks 
between sessions. If students 
need more time, many states 
allow them to continue 
working on the test. Of the 
30 states for which data were 
available, 1 6 had tests that were 
untimed, although for 
scheduling purposes, an 
expected duration was 
to test 

administrators. 

The variation in the duration 
of state tests reflects a lack of 
consensus among 
policymakers, test developers, 
and researchers regarding the 
“ideal” test length. Research is 
inconclusive concerning 
appropriate test length. 13 
Likewise, research on test 
fatigue is incomplete and inconclusive. Some studies suggest that students have more difficultly 
responding to questions that appear later in a test (PISA, 2000; Wise, Chia and Park, 1989), while others 
suggest no differences exist (Rubin and Mott, 1984; Klein and Bolus, 1983; Zwick, 1991), and still others 
are inconclusive (Davis and Ferdous, 2005). 

Since NCLB was signed into law, some observers have suggested that students are spending too much 
time taking tests. However, the state assessments administered for NCUi purposes require only a 
portion of the total time students spend taking tests. One national estimate of the amount of time 
students spend taking tests suggests the average duration of state-administered tests is five days per 
school year; district-required benchmark and diagnostic tests total four days; and teacher-administered 
tests in the classroom may account for as many as nine days of class time (about 1.5 days in each of the 
six, six-week grading periods). 14 States often require testing in addition to what is required under federal 
law; for example, in 2007, 17 states required all high school students to take tests of college readiness, 
including the SAT, ACT, or WorkKeys. In the context of all tests administered by states, districts, and 




Exhibit 5 

Average Test-Taking Duration, Reading and Mathematics, 
Grades 4, 7, and High School, 2006-07 
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Exhibit reads: In eight states with grade 4 tests composed only of 
multiple choice items, the average test duration was 70 minutes in 
2006-07. 

Sources: SSl-NCLB, Title I Assessment and Accountability Interviews and 
Analysis SEA Documents. 



13 Burton (2001, 2005) posits that 60 items is insufficient for measuring a large knowledge domain. However, other 
research suggests that tests shorter than 60 items perform similarly to longer tests (Kim et al, 1994). Although 
researchers have developed a variety of algorithms for identifying the ideal test length, none has come to be widely used 
(Hambleton, 1987, van der Linden, 1980). 

14 See Educational Testing Service (2007). 
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teachers, the state assessments administered for NCLB purposes are one component of the total amount 
of time that students spend taking tests. 

The above estimates do not include time spent on test-taking strategies. It is not known to what extent 
the time that teachers spend on preparing their students for upcoming assessments represents a 
productive instructional activity or takes time away from higher- quality instructional activities. 

Cost of Developing and Administering Reading and Mathematics 
Assessments Under NCLB 

Since fiscal year 2002, states have received assistance from the federal government to support the costs 
associated with developing tests for NCLB purposes. Specifically, Section 6111 authorizes grants to 
states to “pay the costs of the development of additional state assessments and standards required by 
section 1111(b).” For the fiscal years 2002 through 2008, the total federal allocation for all states and 
outlying territories was $2.8 billion. The annual allocation ranged from $387 million in 2002 to 
$409 million in 2008 (see Exhibits B.2 and B.3 in Appendix B for annual appropriations and state 
allocations). 

However, we do not know the actual cost to states of complying with the assessment requirements of 
NCLB. As part of the National Assessment of Title I, Congress called for an examination of the cost of 
developing assessments in grades 3-8 [Section 1501(a)(2)(C)(i)]. For the purpose of this study, we 
interpreted this requirement as pertaining to general assessments in reading and mathematics, and we 
surveyed state assessment directors in all of the states during the 2006—07 school year to ask them to 
estimate the costs their state had incurred for developing such assessments. This survey also collected 
information on the costs of administering and maintaining reading and math assessments required under 
NCLB. We did not include science assessments because NCLB did not require these assessments to be 
in place until the 2007—08 school year. We also did not include alternate assessments or tests of English 
language proficiency. 

For reporting on test development costs, state officials were asked to aggregate costs over time because 
test development is a multiyear process. In contrast, costs associated with the administration and 
maintenance of assessments are recurring annual costs, and state officials were asked to provide 
estimates of these costs for 2006—07 only. 

Costs associated with the development of tests may include, but are not limited to, costs for state education 
agency (SEA) staff, vendor contracts, and consultants to develop test specifications, write and review 
items, obtain necessary copyrights, assemble forms, field test, set standards, conduct psychometric 
analyses, develop special forms to ensure accessibility for all students, and develop systems for reporting 
results. Development costs generally occur over several years, depending on the number of tests states 
need to develop and the types of items they use. Indeed, developing high-quality tests is a labor- 
intensive and technically challenging process. As one scholar commented, “Hundreds of people have to 
touch every item” (Toch, 2006, p.8). Once test development is largely complete, states may no longer 
need to spend resources on test development if they reuse the same items and the same forms; however, 
there are always annual costs associated with test administration and maintenance , and few states reuse all 
items every year. These costs include, but are not limited to, item renewal (and subsequent field testing 
and committee review), production of annual test materials, training local staff, scoring tests, and 
monitoring contractors. 
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There are many challenges to accurately estimating the additional costs that states 
must assume as a result of the NCLB requirements, and it may be difficult for states 
to accurately report on these costs. 

Prior to NCLB, some states had assessment systems that went beyond the specific requirements of the 
previous law and already included some of the components that were newly required under NCLB. For 
example, some states already were administering annual assessments in each grade from 3 through 8 
prior to NCLB. More fundamentally, assessing students is a state role that precedes both NCLB and 
L4SA, and states have periodically revised their assessments or developed entirely new assessment 
systems. Thus, the cost of assessing students, as well as the cost of developing revised or additional 
assessments, cannot be entirely attributed to federal requirements. 

In addition, it may be difficult for states to isolate the specific costs of developing and administering 
reading and mathematics assessments in grades 3—8, because these costs may be combined with those of 
other assessments included in each state’s assessment system. States do not necessarily account 
separately for the costs of developing assessments in different subjects and different grade levels, and 
states may have assessments in subjects and grades that are not required under NCLB. Similarly, states 
may not always account separately for test development and administration costs, particularly when both 
types of costs are bundled together in a single contract with a testing firm. Finally, states may find it 
difficult to account accurately for the cost of assessment development and administration work 
performed by state education staff, district and school officials, and teachers, particularly for those staff 
who have responsibilities other than state assessments. 

Despite these challenges, the following sections summarize the estimates that states reported for the cost 
of developing and administering assessments required under NCLB. 

Costs to develop reading and mathematics assessments in grades 3-8 

Considerable variation across states in their assessment development costs may be expected, because 
states may undertake test development in ways that are more or less complex — with variable costs 
associated with each approach. States may field test items in ways that are more or less expensive, for 
example, by using small or large samples of students in different parts of the state, by embedding the 
field-test items in the “real” test, or by administering a stand-alone field test. In addition, costs may vary 
based on the number of items, item type, cultural bias reviews, and psychometric analyses. Decisions that 
impact the rigor, quality, and cost of test development accumulate as tests become more numerous and 
more complex. Moreover, the maturity and quality of a state testing program prior to NCLB may have 
implications for post-NCLB costs. For example, states that were under compliance agreements under 
IAS A may have had to make more substantive efforts under NCLB to ensure their assessment system 
met federal standards. 

Thirteen states reported that they used existing assessments in reading and 
mathematics in grades 3-8 to meet NCLB accountability requirements. 

Of the 46 states that provided data, 13 indicated they kept their existing assessments in reading and 
mathematics in grades 3—8 for accountability under NCLB. While they may have accrued some costs 
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associated with these tests following NCLB, it is difficult to attribute these expenses to the 2001 law 
given that the tests predated the law. 15 

Twenty-seven states reported costs to develop reading and mathematics 
assessments required under NCLB in grades 3-8, with a median cost of $9.6 million 
per state. The test development costs reported by states varied considerably, from 
a low of $1 .3 million to a high of $51 .1 million. 

Among the 27 states that reported costs of developing or modifying mathematics and reading tests to 
comply with NCLB, the median expenditure was about $9.6 million per state (see Exhibit 6). 16 States 
that reported the highest development costs were Arizona ($51.1 million), Ohio ($42.6 million), and 
West Virginia ($33.2 million). States that reported the lowest development costs were Vermont 
($1.3 million), New Hampshire ($2.0 million), and Oregon ($2.5 million). 

Each state’s total reported cost for developing these assessments did not appear to be related to the 
number of tests each state needed to develop to comply with NCLB. For example, many states opted to 
maintain the tests developed under IAS A for selected grades and developed new ones for missing 
grades. That is, a state may have kept existing tests in grades 4, 6, and 8, in which case the state would 
only have to develop new tests in 3, 5, and 7, for a total of six new tests. Other states developed entirely 
new tests for reading and mathematics for all grades 3-8 (for a maximum of 12 newly-developed tests). 
Of the three states that developed six new tests, the aggregate costs varied from $2.5 million to 
$14.7 million. Among the states that developed assessments for all grades from 3-8, Vermont 17 spent 
the least, $1.3 million, while Arizona spent over $51.1 million. 

It is possible that per-pupil test development costs might be higher in smaller states than in larger states, 
if test development involves fixed costs that may be spread over a smaller or larger number of students. 
Indeed, these data indicate that test development costs per tested pupil were moderately related to state 
size: among the states that tested more than 500,000 students in grades 3—8, the per-pupil test 
development costs were $31, while states that tested fewer than 200,000 students in grades 3—8 reported 
average test development costs of $102 per tested pupil. In addition, the aggregate test development 
costs that states reported were also moderately related to state size: on average, the larger states reported 
the highest aggregate costs, while smaller states reported the lowest costs. However, there was a great 
deal of variation among states in the aggregate amount of costs they reported, and some states with large 
enrollments (such as Illinois) reported costs that were similar to some states with very low enrollments 
(such as Maine). 



15 The states that reported in 2006-07 that they “kept existing” tests are: Arkansas, California, Delaware, Florida, 
Georgia, Indiana, Iowa, Nebraska, New Mexico, North Carolina, North Dakota, Tennessee, and Texas. 

16 These costs are comparable to those reported by other studies that provide national estimates of test development 
costs. For example, the National Association of State Boards of Education reported per-pupil test development costs of 
$25-$125 (the average per-pupil cost of test development, based on the data collected through SSl-NCLB would be 
$68), and the U.S. Government Accountability Office (2003) reported per-state average costs of $13.6 million, assuming 
states retained their current item type. 

17 Some readers may note that Vermont and New Hampshire reported different costs even though these two states 
collaborated, together with Rhode Island, on developing a joint set of assessments (the New England Common 
Assessment Program). The state assessment directors for these two states indicated that not all costs were shared 
equally and that New Hampshire paid for a larger share of these costs. Rhode Island, the third state in this collaborative, 
is not included in Exhibit 6 because that state did not report the requested data. 
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Exhibit 6 

State-Reported Aggregate Costs of Developing or Modifying Reading and 
Mathematics Assessments in Grades 3-8 to Comply With NCLB Requirements, 

in 27 States That Reported Such Data 
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Exhibit reads: Arizona reported spending a total of $51.2 million on the development and modification of 
reading and mathematics assessments in grades 3—8 in order to comply with NCLB. 

Note: State officials were asked to report data on the costs of developing or modifying state assessments in order to comply 
with the NCLB requirement to assess students in grades 3-8 in reading and mathematics. These data therefore represent 
multiple years of expenditures, spanning the development of state assessments required under NCLB. These data represent 
respondents’ best estimates; however, it may be difficult for states to accurately report on these costs and to separate NCLB- 
related costs from assessment costs that would have occurred in the absence of NCLB. In addition, states may vary in the 
ways in which they account for these costs and thus the data shown here may not be consistent across states. 

Sources: SSl-NCLB, Title I Assessment and Accountability Interviews and Analysis of SEA Documents ( n = 27 states). 
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Costs to administer reading and mathematics assessments in grades 
3-8 and high school 



In contrast to development costs, test administration and maintenance costs recur on an annual basis. 

For this study, states were asked to report their test administration costs in 2006—07 and were specifically 
asked to include costs associated with: 

• layout, design, editorial, production, printing, shipping, tracking, scanning, and scoring of tests; 

• monitoring of testing contractors; 

• training of state users and administrators; 

• maintaining test banks; and 

• test accommodations, including training and special equipment. 

It is important to note that these test administration costs cannot all be considered as costs of complying 
with NCLB, because states have long administered statewide assessments in at least some of these grades 
and likely would have continued to do so even in the absence of the NCU3 assessment requirements. 
Also, unlike the previous section on the costs of developing and modifying reading and math 
assessments, the administration costs covered in the following section include the cost of administering 
high school assessments as well as assessments in grades 3—8. 

In 2006-07, the median cost that states reported for administering reading and 
mathematics tests in grades 3-8 and high school was $25 per tested pupil. 

Across the 39 states that reported these data, the median per-pupil cost to administer and maintain 
assessments in reading and mathematics in grades 3—8 and high school was $25, ranging from a low of 
$3 per tested pupil in North Carolina to a high of $99 per pupil in Delaware (see Exhibit 7). 18 Most of 
the states (29 out of 39) reported costs of between $12 and $42 per pupil. The median reported total 
cost for test administration and maintenance in 2006—07 was $7.5 million, ranging from a low of 
$1.2 million in Wyoming to a high of $77 million in California. 



18 These costs are comparable to those reported by other studies that provide national estimates of test administration 
costs. For example. Accountability Works reported a range of per-pupil test administration costs of $5— $15, the 
National Association of State Boards of Education reported per-pupil administration costs of $25-$50, and the 
Educational Testing Services estimated costs in the range of $15-$35 per pupil. 
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Exhibit 7 


State-Reported Annual Per-Pupil Costs of Administering and Maintaining 


Reading and Mathematics Assessments in Grades 3-8 and High School, 2006-07, 

in 39 States That Reported Such Data 
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Exhibit reads: In 2006-07, Delaware reported spending an average of $99 per tested pupil to administer 


and maintain reading and mathematics tests required under NCLB in grades 3—8 and high school. 


Note: To calculate per-pupil test administration costs, each state’s reported total cost for administration and 


maintenance of reading and mathematics assessments in grades 3-8 and high school for 2006-07 was divided by the 


number of students tested in grades 3-8 and high school, as reported in the Consolidated State Performance Reports. 


These data represent 


respondents’ best estimates; however, it may be difficult for states to accurately report on these 


costs and to separate IVCLB-related costs from assessment costs that would have occurred in the absence of NCLB. 


Sources: SSl-NCLB, Title I Assessment and Accountability Interviews and Analysis of SEA Documents (» = 39 states). 
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Smaller states reported incurring higher per-pupil costs for test administration and 
maintenance than did larger states. 

Reported annual costs for test administration and maintenance expenditures varied by state size: annual 
average administrative and maintenance costs reported by the four states with the highest enrollment 
were far higher than those reported by the six states with the lowest enrollment ($38.7 million compared 
to $2.8 million). However, reported average per-pupil costs were higher in the smaller states than in the 
larger states ($44 per pupil compared to $20 per pupil). Thus, while larger states reported incurring 
higher administration costs overall, they benefited from economies of scale that resulted in lower per- 
pupil expenses (see Exhibit 8). 



Exhibit 8 

Average State-Reported Annual Total Cost and Per-Pupil Cost of Administering and 
Maintaining Reading and Mathematics Assessments in Grades 3-8 and High School, 

by State Enrollment Size, 2006-07 
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Exhibit reads: In states with fewer than 200,000 students, the average state-reported total expenditures for 
administering and maintaining state assessments in reading and mathematics in 2006-07 were $2,861,100. 

Sources: SSI-1VCLB, Title I Assessment and Accountability Interviews and Analysis of SEA Documents (« = 39 
states). 



Tests with only multiple-choice questions were reported to be less expensive to 
administer than tests with open-ended item types. 

On average, states whose assessments relied entirely on multiple choice items reported that they spent 
less on test administration compared with states that incorporated a mix of item types, including short 
answer or extended response items. In states in which the tests were composed entirely of multiple 
choice items, reported test administration costs averaged $24 per tested pupil, compared with $31 per 
pupil in states that used a combination of item types. Responses to such questions are not scanned, but 
must be scored by a trained professional, resulting in additional costs. 

Finally, test administration costs were moderately related to the length of the test: In the cluster of states 
with the shortest tests (shorter than 108 minutes, on average) the average reported cost for test 
administration and maintenance in 2006—07 was $27 per pupil. In the cluster of states with the longest 
tests (on average, longer than 1 80 minutes) the average cost for test administration and maintenance in 
2006-07 was $40 per pupil. Overall, however, test duration and administration costs were weakly 
correlated: from a low of 0.09 for seventh-grade mathematics to a high of 0.37 for high school English. 
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Including All Students in Assessments 



NCEB places great emphasis on the inclusion of all students in statewide assessments. In the case of 
students with disabilities or limited English proficiency, this inclusion is an essential foundation for 
ensuring equal opportunity to achieve the state’s common high standards. When large groups of 
students go untested, the school and the larger system lack needed information to monitor progress, 
detect low performance, and adjust educational strategies. 

Testing all students in a valid, fair, and reliable way presents challenges. While most students with 
disabilities or limited English proficiency can participate in the general statewide assessments with or 
without accommodations, others require alternate assessments. In fact, NCEB and the Individuals with 
Disabilities Education Act (IDEA ) require such assessments for students with disabilities; whether alternate 
assessments are at grade-level or based on alternate academic achievement standards is left up to each 
state to decide. (With the issuance of final regulations in April 2007, states may also develop alternate 
assessments based on modified academic achievement standards; information on the development of 
such assessments is not included in this report.) 

Students with disabilities 

Federal law requires states to include all students with disabilities in their assessment and accountability 
systems in a manner that allows these students to receive valid test scores. While federal guidance does 
not require a particular type of assessment, it does require states to have at least one alternate assessment. 
Students with disabilities typically participate in proficiency assessments in one of two ways: Participation 
in the general assessment (with or without accommodations) or participation in an alternate assessment 
based on alternate academic achievement standards. 

All states allowed testing accommodations to enable the majority of students with 
disabilities to take the general state assessments. 

Accommodations are changes made to standard test conditions that mitigate problems unrelated to 
knowledge of content that a student with a disability may face when taking a test. These changes do not 
affect the integrity and purpose of the test. In 2006-07, all states allowed testing accommodations for 
students with disabilities taking the general state assessments. The accommodations most frequendy 
approved by states in 2004—05 included the following (Lazarus et al., 2006): 19 

• presentation accommodations — large-print tests (48 states), sign interpretations of questions 
(43 states), Braille (44 states), instructions read aloud to student (41 states); 

• equipment and material accommodations — magnification equipment (42 states), amplification 
equipment (39 states), light or acoustics accommodations (33 states); 

• response accommodations — computer or machine (25 states), Braille (34 states), write-in test 
booklets (35 states); 

• scheduling and timing accommodations — test administration with breaks (40 states), multiple 
sessions (23 states), time beneficial to students (37 states); 

• setting accommodations — small-group administration (45 states), individual administration 
(45 states), carrel administration (35 states). 



19 This study did not track the frequency of use of specific accommodations. 
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There are several types of alternate assessments (see Exhibit 9), and these assessments may use different 
methods of measuring student achievement, such as portfolios of student work demonstrating student 
performance relative to the content standards. With these methods, the progress of students with 
varying levels of cognitive disabilities can be evaluated based on achievement standards appropriate for 
their intellectual development, giving states the opportunity to more accurately gauge their academic 
progress. 



Exhibit 9 

Characteristics of Types of Assessments and Participating Students 
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Source: Adapted from National Alternate Assessment Center, Warlick, K., & Towles-Reeves, E. (July 2005). Current 
issues in alternate assessment on alternate achievement standards. Presentation at the annual meeting of the Office of Special 
Education Programs Project Directors’ Conference, Washington, D.C. http:/ /www.naacpartners.org/products/ 
presentations/national/OSEPprojectDirectors/lOOOO.pdf (accessed Oct. 17, 2008). 



Alternate assessments have been required since 2000, and by 2005-06, all states 
administered some form of alternate assessment for students with disabilities. 

The 1997 reauthorization of IDEA required that states include students with disabilities in statewide 
assessment programs and administer alternate assessments for students with disabilities who cannot 
participate in the state’s general assessment even with appropriate accommodations. Prior to this federal 
mandate, such students were frequently excluded from large-scale testing programs. In 1999—2000, 

12 states had alternate assessments in place, and 35 were in the process of developing them (Goertz and 
Duffy, 2001). 

Under NCLB, alternate assessments must be “aligned with the [sjtate’s content standards, must yield 
results separately in both reading/language arts and mathematics, and must be designed and 
implemented in a manner that supports use of the results as an indicator of AYP.” 20 Alternate 
assessments may be needed for students who have a broad variety of disabilities; consequently, a state 
may employ more than one type of alternate assessment (see Exhibit 9). Alternate assessments can 
measure proficiency based on grade-level achievement standards and can also measure proficiency based 
on alternate academic achievement standards for students with the most significant cognitive disabilities. 
Indeed, a “1 percent rule” permits up to 1 percent of students in a state or district to be counted as 



20 U.S. Department of Education, (2005). Don-Regulatory guidance: Alternate achievement standards for the students with the most 
significant cognitive disabilities. Washington, D.C.: Author, p. 15. http:/ /www.ed.gov/policy/elsec/guid/altguidance.doc 
(accessed October 2008). 
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proficient (for AYP purposes) on an alternate assessment based on alternate achievement standards that 
are aligned with grade-level content standards. States may also develop modified academic achievement 
standards and assessments based on those standards for certain students with disabilities. The 
participants in the alternate assessments based on modified academic achievement standards would be 
the small group of students with disabilities for whom an alternate assessment based on alternate 
academic achievement standards would not be appropriate, but whose disability has precluded them 
from achieving grade-level proficiency on the assessment based on grade-level academic achievement 
standards and whose progress is such that they will not reach grade-level achievement standards in the 
current year. Under federal regulations, states and districts are allowed to include in AYP determinations 
the proficient and advanced scores from assessments based on modified academic achievement 
standards, subject to a 2 percent cap at the state and district level based on the total number of students 
in the grades assessed [34 C.F.R. § 200.13 (c)(2)(ii)]. 

NCLB required all states to have full assessment systems in reading and mathematics in place by 
2005—06, including one or more alternate assessments for students with disabilities who could not 
take the general assessments even with accommodations. Similarly, IDEA requires states to develop 
an alternate assessment for all statewide tests, not just those required for determining AYP under 
NCEB. All states made efforts to comply with these statutory requirements. By 2005—06, all 50 
states, the District of Columbia and Puerto Rico had alternate assessments in reading and 
mathematics, although three (Kentucky, Maine, and New Jersey) were missing some of the required 
grades, that is, grades 3—8 and at least one grade in high school. Thirty states administered alternate 
assessments in science as well. 21 Some states were still developing alternate assessments in other 
academic subjects (e.g., science and social studies) as well as topics such as interpersonal skills, 
technology and recreation or leisure activities (see Exhibit 10). 

As of July 2006, peer reviews of state assessment systems found that 38 states had 
not demonstrated that their alternate assessments based on alternate academic 
achievement standards (AA-AAAS) met all NCLB requirements. By January 2009, 
only 13 states had not yet received approval of their AA-AAAS. 

Developing AA-AAAS that met peer review standards proved to be a challenge for states. As of late 
2006, 38 states had not yet received approval for their AA-AAAS; shortcoming of alternate assessments 
were among the most common reasons that states’ assessment systems did not receive full approval 
(however, AA-AAAS were not the only reason that states did not receive full approval). In January 
2009, only 13 states continued to face challenges with regard to their AA-AAAS, and two of these had 
opted to overhaul their assessment systems entirely. The main challenges still faced by states concerned 
alignment (linkage) with grade-level content and the technical quality of the alternate assessments 
(including validity and reliability as well as achievement standards setting). 



21 Based on a review of policy documents available on state education agency Web sites, January 2007. 
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Exhibit 10 

Number of States With Alternate Assessments, by Subject, 2005-06 




Exhibit reads: Fifty states, the District of Columbia, and Puerto Rico had mathematics alternate 
assessments in place in the 2005—06 school year. 

Note: Alternate assessments in science, writing and social studies are not required under NCLB, but states are 
required by IDEA to have them if they administer a statewide assessment. 

Source: SSl-NCLB, Title I Assessments and Accountability Interviews (» = 50 states, the District of Columbia, and 
Puerto Rico). 



To comply with NCLB requirements, one-third of states reported that they developed 
entirely new AA-AAAS. 

When NCLB was passed in 2001, each state was at a different point in the process of developing AA- 
AAAS. Whereas some states had alternate assessments in place and either kept or modified their existing 
test, other states chose to develop entirely new assessments to appropriately test students with the most 
severe cognitive disabilities. In 2006-07, 18 states (of 42 responding) reported they developed entirely 
new AA-AAAS in response to NCLB, while 15 states chose to modify their existing AA-AAAS. 

Officials from nine states reported that they chose to retain their existing AA_AAAS (see Exhibit 11). 
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Exhibit 11 

State Development of Alternate Assessments Based on 
Alternate Academic Achievement Standards for NCLB, 2006-07 




Exhibit reads: Fifteen states developed new alternate assessments based on alternate achievement 
standards to meet NCLB requirements. 

Source: SSl-NCLB, Title I Assessments and Accountability Interviews (» = 42 states). 



Students with limited English proficiency 

All states allowed LEP students to take assessments with accommodations, but 
states varied widely in the percentages of students actually using them. 

Title I requires that all LEP students — except for those who have been enrolled in schools in the U.S. 
for less than 12 months — be included in academic content area assessments with reasonable 
accommodations, including native language versions of the assessments. 22 In 2005—06, all states allowed 
LEP students to use a variety of accommodations when taking state content assessments, the most 
common accommodations being small group or individual test administration or reading the directions 
aloud to students (see Exhibit 12). Accommodations for LEP students fall into the general categories of 
presentation, setting, timing, and response. 



22 In February 2004, the U.S. Department of Education announced new flexibility (formalized through regulation in 
2006) allowing LEP students, in their first year of enrollment in U.S. schools, to take an English language proficiency 
assessment instead of the state reading assessment, permitting states to exclude those students’ reading and mathematics 
scores from AYP calculations, and permitting states to retain formerly LEP students in the LEP subgroup for AYP 
calculations for up to two years after they attain English proficiency. 
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Exhibit 12 

Six Most Commonly State-AI lowed Accommodations for Students With 
Limited English Proficiency Taking Content-Area Assessments, 2006-07 
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Exhibit reads: Forty-five states used small groups or individual administrations as an accommodation for 
LEP students taking state content-area tests. 

Sources: Biennial Evaluation Report to Congress on the Implementation of the State Formula Grant Program, 
2002-04; English Language Acquisition, Language Enhancement and Academic Achievement Act ( ESEA , Title III, Part A) 

(« = 45 states, the District of Columbia, and Puerto Rico). 



The percentage of LEP students actually using accommodations varied greatly from state to state. Of 
the 29 states that tracked and reported this information, the percentage of LEP students who took 
accommodated reading or mathematics assessments in 2003—04 ranged from 100 percent in Louisiana, 
North Carolina, and the District of Columbia to 6 percent in Texas and Idaho. 23 The percentage of 
students assessed using accommodations did not seem to be associated with the total number of LEP 
students tested in the state; both high and low percentages were reported for states with large and small 
LEP student populations. 

NCLB also allows for the use of native language assessments, provided the assessment is comparable to 
the English version and aligned to the state content and academic achievement standards. Because 
native-language assessments are costly and difficult to develop, only 10 states reported having them 
available. In 2005—06, most of these assessments were in Spanish (eight); however, in addition to Spanish, 
two states reported that they also administered assessments in additional languages, including Arabic, 
Chinese, Gujarati, Haitian-Creole, Hmong, Japanese, Korean, Portuguese, Russian, Somali, and 
Vietnamese. 

Even when a state had a native-language assessment in place, the assessment was not available for all 
grades in all subjects. In 2005—06, for the subjects covered by NCLB, eight states offered native- 
language assessments in mathematics, four offered them in reading, and one offered them in science. 

For some states, native-language assessments were offered for grade-level ranges (e.g., 3—8) or separate 
grade levels. 



23 These figures are drawn from responses of State Title III Directors to a set of pre-interview questionnaire items in fall 
2004; responses did not indicate the nature of the accommodations included. 
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Defining Student Proficiency: Academic Achievement Standards 



NCLB sets the goal of all students reaching proficiency in reading and mathematics by 2013—14, but 
each state must define the level of student performance that is to be labeled “proficient” on its statewide 
assessments. Each state’s definition of proficiency is reflected in its academic achievement standards 
(previously referred to as performance standards under IAS A) for each grade level and subject tested. 

As described in federal non-regulatory guidance, “Student academic achievement standards (called 
performance standards under the 1 994 reauthorization of the dementary and Secondary Education Act of 
1965) are explicit definitions of what students must know and be able to do to demonstrate proficiency. 
Achievement standards further define content standards by connecting them to information that 
describes how well students are acquiring the knowledge and skills contained in academic content 
standards.” 24 Academic achievement standards include achievement-level descriptors that clarify student 
skills and anchor the achievement standards to the content standards. For example, one descriptor in 
Illinois reads: “Students who meet the standard can use correct grammar, spelling, punctuation, 
capitalization and structure.” States must also determine the “cut scores” on the state assessment that 
determine each achievement level. Finder NCLB, states are required to establish at least three 
achievement levels — often referred to as basic, proficient, and advanced. However, most states 
(42 states as of 2003—04) had opted to designate four or five achievement levels, with the additional 
levels usually, but not always, being set below the basic level. 

States determine achievement level cut scores through systematic judgmental processes that often 
involved committees of psychometric experts, teachers, and administrators. The most frequendy 
employed strategy for setting cut scores is called “bookmarking” (Mitzel, 2005). During this process, 
participants review test booklets in which items are arranged from least difficult to most difficult. 
Committee participants then set “bookmarks” to delineate different levels, consistent with the 
achievement-level descriptors. 

Student “proficiency” has little common meaning across states. 

Academic achievement standards for proficiency are pivotal to NCLB accountability: schools’ AYP 
determinations are based on each subgroup of students reaching the state-defined proficiency level. 

Thus, states’ definitions of academic proficiency play a key role in determining how well the state 
performs under NCLB. Because states establish academic achievement standards relative to their 
content standards and assessments, these standards can, and do, vary from state to state. 25 

One way to measure the amount of variation in proficiency standards is to compare each state’s test 
against a common external benchmark. The only benchmark available across all states is the National 
Assessment of Educational Progress (NAEP). An analysis examined how state proficiency levels in 
reading and mathematics for grades 4 and 8 varied against this common metric (National Center for 
Education Statistics, 2007; see also McLaughlin, Bandeira de Mello, Blankenship, Chaney, Hikawa, Rojas, 
William, and Wolman, 2007). Using a process called equipercentile mapping, 26 the researchers calculated 
NAEP scale equivalents for the mathematics and reading standards for proficiency in each state. 



24 U.S. Department of Education (2003). Non-regulatory guidance: Standards and assessments. Washington, D.C.: Author, p.l. 
http://www.ed.gov/ policy/ elsec/guid/ saaguidance03.doc (accessed October 2008). 

25 Such variation does not imply that states are out of compliance with NCLB. The law does not define either state 
content standards or academic achievement standards. 

26 Equipercentile mapping is a process in which the percentages of students meeting the state proficiency standards in 
schools participating in NAEP in each state were matched with the distribution of performance on NAEP of students in 
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States varied widely in the levels at which they set their performance standards in reading and 
mathematics, when compared to NAEP. Using NAEP as a common external metric, state standards for 
proficiency in eighth-grade mathematics under NCLB range from a NAEP equivalent score of 
approximately 230 to 311 (see Exhibit 13). 27 Similar patterns occurred in fourth-grade mathematics and 
in reading at both grade levels. As a result, a student deemed to be proficient for NCLB purposes in one 
state might not be considered proficient in another state, and cross-state comparisons and nationwide 
estimates of the percentage of students who are proficient must be interpreted with caution. 

This variation in academic achievement standards should be taken into account in any examination of 
state variation in the numbers and percentages of schools that make or do not make AYP or are 
identified for improvement. Relative to one another and to NAEP, states can be categorized as setting 
their standards for proficiency at low, medium, and high levels of expected performance. Chapter III of 
this report incorporates these categories in analyses of AYP results across states. 

Measuring Progress Toward Proficiency: Adequate Yearly Progress 

State measures of AYP are the foundation of NCLB accountability. Both Title I and non— Tide I schools 
must meet AYP targets; AYP is the accountability mechanism with the greatest scope, affecting all public 
schools in the United States. State AYP accountability mechanisms have three components: 

1 . AYP indicators — percentage of students performing at the proficient level on statewide 
assessments in reading and mathematics, student test participation rates, and other academic 
indicators. 

2. AYP targets — starting points, annual measurable objectives, and intermediate goals for percent 
proficient in reading and mathematics. 



those same schools. The accuracy of this metric depends on the correlations between NAEP and state assessment 
results. In the majority of the states examined, the standards were sufficiently correlated to warrant reporting the NAEP 
equivalents. Exhibit 14 displays data only for those states with sufficiently high correlation between NAEP and the state 
assessment. 

27 Note that the state rankings reported in Exhibit 14 are slightly different from those reported in Le Floch et al., 2007. 
Because the interim report reflected data collected in the fall of 2004, its analyses of state proficiency definitions 
employed the then-current 2003 proficiency levels. The current report, which focuses on the fall 2006 data collection 
uses equating analyses conducted on the 2005 state proficiency levels. As some states recalibrated the level at which they 
set student proficiency between 2003 and 2005, the relative positioning of states changed slightly between the two 
reports. 
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Exhibit 13 

NAEP Scale Equivalents of State Proficiency Standards, 
by State, for Eighth-Grade Mathematics, 2005 
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Exhibit reads: On average, students who met the state’s proficient level in Tennessee would be estimated to 
score 230 or higher on NAEP while students who met the state’s proficient level in Missouri would have an 
estimated NAEP score of 311 or above. 

Note: By matching percentages of students meeting state standards in schools participating in NAEP with the distribution 
of performance of students in those schools on NAEP, state standards for proficiency may be mapped to scores on the 
NAEP scale. 

Source: National Center for Education Statistics, 2007 (« = 34 states and the District of Columbia). 
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3. Methods to avoid misclassifying schools — “safe harbor,” minimum n, confidence intervals, 
and definitions of full academic year. 

The U.S. Department of Education permits states to seek amendments to their iVCLB accountability 
plans, including elements of their AYP definitions. 

Selecting AYP indicators 

1VCLB requires states to use five indicators to determine AYP: (1) the percentage of students who are 
proficient in reading as measured by the state reading assessment; (2) the percentage of students who are 
proficient in mathematics as measured by the state mathematics assessment; (3) the percentage of 
students who participate in state reading assessments; (4) the percentage of students who participate in 
state mathematics assessments; and (5) at least one other academic indicator at each school level 
(elementary, middle, and high school). Even small differences in the rules for calculating each AYP 
indicator can affect whether schools or districts make adequate yearly progress. For this reason, states 
have given considerable attention to the details of their choices. 28 

For calculations based on 2005-06 tests, fewer than half of states granted 
exceptions allowing districts to exceed the 1 percent cap on the inclusion of scores 
from alternate assessments based on alternate academic achievement standards. 

States must include in AYP calculations the scores of students assessed using the alternate assessment 
based on alternate academic achievement standards — provided that the number of students identified as 
proficient using the alternate assessment did not exceed 1 percent of all students tested. Districts can 
request from their state an exception to exceed the 1 percent cap and, prior to the release of the April 9, 
2007, regulations, states could request exceptions of the U.S. Department of Education to exceed the 
1 percent cap. When calculating AYP based on 2005—06 testing, less than half of states granted 
exceptions to districts to exceed the 1 percent cap: Of the 49 states, the District of Columbia, and Puerto 
Rico for which data were available, 22 reported having granted exceptions to districts. Twenty-six states, 
the District of Columbia, and Puerto Rico indicated that they had not granted exceptions to districts, in 
most cases because no districts had requested an exception. While several states granted exceptions to 
fewer than 10 districts, Iowa approved exceptions for 63 districts (many very small), and Ohio approved 
nearly 100 (see Appendix B, Exhibit B.4). For the 22 states in which data were available, in most cases 
districts exceeded the 1 percent cap by only 1 or 2 percentage points. Districts that exceeded the cap by 
more than 2 percentage points often had very low student enrollments. 

In addition to measures of student proficiency in reading and mathematics, measures of AYP must 
incorporate at least one other indicator for each schooling level. At the elementary and middle school 
levels, each state selects this indicator. Attendance was the most common “other academic indicator” 
(used by 35 states) for elementary and middle schools in 2006—07, but some states chose to use 
additional achievement measures instead. These states included results from other state assessments, 
including writing or science assessments (seven states), or performance increases on a state index 
(four states). Other indicators also included reductions in the percent of students with below-basic 
performance (V ermont) and, conversely, increases in the percent of students that score at the advanced 
level (Idaho) (see Appendix B, Exhibit B.5). 



28 See Appendix B, Exhibit B.3, for information on key features of state approaches to AYP in 2003—04. 
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All states were required to establish high school graduation targets. Among the 47 
states and the District of Columbia that reported high school graduation targets for 
2006-07, the average target was 77 percent: targets for 2006-07 ranged from 50 to 
95 percent. 

While graduation rates are a required AYP indicator for high schools, there is still a great deal of 
variation in the ways in which states calculate graduation rates and in the states’ capacity to process data 
on high school completion. 29 The National Governors Association has led an initiative to encourage all 
states to adopt the same approach to calculating graduation rates. Under this initiative, states will track 
individual student progress over time, including students who change high schools and those who 
receive a GED. In 2008, 19 states were able to report a graduation rate consistent with the NGA 
approach; other states projected they would be able to do so within a few years 30 

In addition, in October 2008, the U.S. Department of Education published regulations that included new 
requirements for calculating graduation rates. Starting with graduation data from 2010—11, these 
regulations require states and districts to report a four-year adjusted cohort graduation rate, disaggregated 
by subgroups, at the school, district and state levels. Furthermore, states must use that rate, 
disaggregated by subgroups, in making AYP determinations for schools, districts, and the state, 
beginning with determinations that are based on 2011—12 assessments results. These 2008 regulations 
also require states to set a goal and targets for high school graduation. 

In 2006—07, the way in which states determined AYP targets for graduation varied greatly. 31 In contrast 
to the mandatory 100 percent proficiency states must meet by 2013—14 for reading and mathematics, 
states have flexibility in setting their annual targets and long-term goals for graduation. States use two 
general approaches for setting graduation targets, minimum thresholds and progressive annual targets. 
Overall, 31 states and the District of Columbia have set a minimum threshold that schools must meet, or 
toward which they must progress in order to meet AYP for the graduation rate. These minimum 
threshold levels range from 50 to 90 percent, with an average of 80 percent. In these states, a school 
also meets the AYP target for graduation rate if they satisfy the state-defined standard for improvement 
in their graduation rate. For example, in Arizona, “The performance levels schools and LEAs must meet 
to make AYP are a 90 percent attendance rate, or a 7 1 percent graduation rate. In either case, a school 
or LEA is deemed to have met the goal if it demonstrates a 1 percentage point improvement over the 
previous year.” 32 

While not required, 16 states had established progressive annual targets for high school graduation 
(see Exhibit 14 for examples of four state trajectories). Among these states, the range for the 2013—14 
graduation rate goals varied from 65 to 100 percent. For example, Michigan has set its long-term 
graduation target at 90 percent, explaining, “It is not an expectation that, like student proficiency in 
English Language Arts and Mathematics, the target goal for graduation rate in Michigan should reach 
100 percent by 2013—14. The reality of high school enrollment, in Michigan and elsewhere, would make 
this an improbable if not impossible goal to reach. It is expected, however, that growth toward higher 



29 National Center for Educational Accountability state data collection survey results. 

http:/ /www.dataqualitycampaign.org/ survey_results/ state_specific_survey_responses.cfm (accessed December 2008). 

30 Curran (2006). 

31 Note that the calculation of graduation rates is a different issue than the determination of whether a school has made 
or not made AYP targets for graduation. 

32 Arizona Consolidated State Application Accountability Workbook. 

http:/ / www.ed.gov/ admins/lead/ account/ stateplans03/ azcsa.doc (accessed March 2009). 
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targets should be encouraged.” 33 Oklahoma, for its part, “would like to encourage schools to meet the 
goal of a 100 percent graduation rate by 2013— 14. ” 34 While the state has established annual targets that 
progress toward 100 percent, schools are considered to have met AYP targets for graduation if they post 
an increase over the previous year’s graduation rate. 



Exhibit 14 

Annual Graduation Rate Targets for AYP in Four States 




Exhibit reads: Colorado’s graduation rate target was 55.3 percent in 2002 and progresses to a target of 
65 percent in 2014, while Maine starts at 60 percent in 2002 and progresses to 75 percent in 2014. 
Source: SSI-NCLB, Analysis of State Accountability Workbooks. 



Of the states that had approved amendments in 2006 and 2007, 23 states allowed more than four years 
to graduation (for students with such provisions written into their individualized education programs, or 
for LEP students). Finally, as in prior years, several states have amended their AYP definitions in 2006 
and 2007 to permit progress toward the attainment of graduation targets, rather than actual attainment of 
those targets. 

Setting targets for performance 

NCLB requires states to set proficiency targets in increments from the percentage of students scoring 
proficient at the point at which NCLJi went into effect in 2001—02 to the ultimate goal of 100 percent in 
2014. Targets give systems near-term goals to shoot for and also allow them to determine whether the 
progress being made at any point in time is sufficient for reaching their long-term objective. 



33 Michigan Consolidated State Application Accountability Workbook. 

http:/ / www.ed.gov/ admins/lead/ account/ stateplans03/ micsa.doc (accessed October 2007). 

34 Oklahoma Consolidated State Application Accountability Workbook. 

http:/ /www.ed.gov/admins/lead/account/ stateplans03/okcsa.pdf (accessed October 2007). 
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Establishing a Starting Point 

One of the states’ first required tasks, after defining their AYP indicators, was to establish starting points 
with respect to the percentage of students scoring proficient on state tests in reading and mathematics at 
the outset of NCLJ5 implementation, as well as trajectories of expected progress toward the goal of 
100 percent proficiency in each subject by 2013—14. 

Under NCLB, states with appropriate data from 2001-02 were required to use those results to determine 
their starting points for establishing AYP targets in reading and mathematics. As required by statute, 
starting points were to be the higher of the percentage of students at the proficient level in (1) the state’s 
lowest-achieving subgroup, or (2) the school at the 20th percentile among all schools based on 
enrollment, ranked by the percentage of proficient students. In most states, this latter process yielded 
the higher percentage. Thus, the percentage of students scoring at the proficient level in the school at 
the 20th percentile of enrollment became the AYP starting point for the state. States were allowed — but 
not required — to establish different starting points by grade span (for example, grades 3—8), by school 
level (elementary, middle, high school), or by grade. The same starting points had to be used for all 
subgroups and for all schools within the state. 

The resulting starting points used to develop the AYP targets for each subject varied among states. For 
example, starting points for elementary reading ranged from 14 percent of students proficient in 
California to 77 percent of students proficient in Colorado. In elementary mathematics, the range was 
greater: from 8 percent of students proficient in Missouri to 75 percent of students proficient in North 
Carolina. Twenty states and the District of Columbia had starting points lower than 50 percent in 
elementary reading; 29 states, the District of Columbia, and Puerto Rico were below this mark in 
elementary mathematics. High schools are furthest from the target, with 29 states, the District of 
Columbia, and Puerto Rico having starting points of less than 50 percent proficiency, and 1 3 states and 
the District of Columbia starting with fewer than 30 percent proficient. 

This variation in starting points has implications for evaluating progress across states. Because states did 
not start at the same place (as indicated by the ranges noted above), some have much farther to go to 
realize the goal of 100 percent proficiency. For example, in ten states and the District of Columbia, the 
starting point for mathematics was below 20 percent proficient. In contrast, North Carolina’s starting 
point was 75 percent proficient (thus far fewer students need to increase their performance to the 
proficient level in North Carolina than in other states). 

The variation in AYP starting points— and hence in how much progress a state must 
make by 2014— is strongly related to how high the states set their academic 
achievement standards for proficiency. 

As discussed earlier, one way to measure the variation in academic achievement standards across states is 
to compare each state’s cut score for determining proficient performance relative to the proficiency 
score used by NAEP. There is a negative correlation (r = —0.55 for eighth-grade mathematics to —0.74 
for eighth-grade English language arts) between states’ academic achievement standards (converted to 
the NAEP scale) and starting points for NCLB accountability. In other words, states that set higher 
academic achievement standards tend to have a lower percentage of students scoring at the proficient 
level and therefore must make greater progress in student achievement by 2013—14 (see Exhibit 15). 
States with higher performance standards in mathematics, for example, must realize an average increase 
of 77 percentage points in the share of students who are proficient by 2013—14, while states with lower 
performance standards have to realize an average increase of 43 percentage points. 
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Annual Measurable Objectives 

Under NCLB, each state must set statewide annual measurable objectives (AMOs) for mathematics and 
reading assessments. AMOs identify the minimum percentage of students (among those enrolled for a 
full academic year) required to meet or exceed the proficient level on the academic assessments in a given 
year. AMOs may vary by grade span or by grade, and they are not required to apply to the same interval 
from year to year. The first increase was required in two years or less after NCUi implementation (by 
2004—05), and the subsequent increases must occur at not more than three-year intervals. 



Exhibit 15 

Improvement Needed to Reach 100 Percent Proficient by 2013-14, 
by Level of Difficulty of State Academic Achievement Standards, 
for Eighth-Grade Mathematics 



1 



a 



a 




Exhibit reads: States that set higher standards for proficiency relative to other states had an average starting 
point for their AYP target for eighth-grade mathematics of 23 percent; they need to increase the percentage 
of students achieving at the state proficiency level by 77 percentage points, on average, in order to achieve 
the goal of all students achieving at the state’s proficient level by 2013—14. 

Sources: SSI-NCLB analyses (» = 34 states and the District of Columbia). 



In 2006—07, state approaches to setting their AMOs and intermediate goals 35 fell into one of three 
common types of trajectories — linear, stair-step, or mixed (see Exhibit 16). Most states chose to start 
their trajectories with little or no growth required in the first two to three years after NCUi 
implementation, but after this initial period of time: 

• nine states had linear growth plans that expect roughly equal increments of progress each year; 

• fourteen states, the District of Columbia, and Puerto Rico had “stair-step” plans in which the 
AMO remains the same for two or three years before increasing, and this pattern is repeated 
until the AMO equals 100 percent proficient); 



35 Intermediate goals, as specified under NCLJi, may be set at a maximum of three-year intervals and must increase in 
equal increments over the 12-year period (2001—02 through 2013—14). 
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• twenty-seven states had a “mixed pattern” plan in which AMOs follow a stair-step pattern for a 
few years, then switch to a linear trajectory. 



Exhibit 16 

Examples of Stair-Step, Linear, and Mixed-Pattern AMO Trajectories (Mathematics) 
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Exhibit reads: North Dakota’s mathematics trajectory exemplifies a linear pattern; Washington’s is 
stair-step; and Louisiana’s is a mixed-pattern trajectory. 

Source: SSl-NCLB, Analysis of State Accountability Workbooks. 



In setting AMOs for achievement growth, 27 states start with small increments then 
increase growth expectations after 2009. 

An important feature of the “mixed pattern” trajectories established by many states is that, on average, 
they project a more rapid increase in the latter years of NCLB implementation than in the initial years. 
Indeed, among these states, the average required annual growth in the initial (stair-step) part of the 
trajectory is only 3 percentage points; when the trajectory becomes linear, however, the annual expected 
growth is 8 percentage points. In other words, the rate of growth is expected to accelerate in the latter 
half of the NCLB time period. 

In the “mixed-pattern” states, only 28 percent of the total required growth is expected to occur in the 
first half of the trajectory (from 2004 to 2009), while 72 percent of the achievement growth is expected 
in the last five years (from 2009 to 2014) (see Exhibit 17). 36 This means that these states expect 
achievement to increase twice as fast between 2009 and 2014 as it is expected to increase between 2004 



36 Because states were not required to increase their AMOs for the first two years of NCLB implementation, these 
analyses were conducted starting from spring 2004. 
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and 2009. In contrast, the linear and stair-step states expect consistent increases over the full 12-year 
period. 



Methods to ensure the 
validity and reliability of AYP 
determinations 

It is important to ensure that AYP 
calculations are valid (i.e., measure the right 
things) and reliable (i.e., avoid year-to-year 
fluctuations not related to changes in 
student achievement). To the extent 
practicable, AYP designations should not 
be the result of random fluctuations in the 
individual students tested, the specific 
questions included in the assessment, or 
the peculiarities of the testing situation. 

Nor should AYP designations — and 
ultimately, the identification of schools for 
improvement — be determined by the 
performance of students who did not 
receive at least one year of instruction in 
the school. Some of the most common 
means for ensuring the validity and 
reliability of AYP determinations include 
the following (see Appendix B, Exhibits 
B.5 and B.6 for information on the scope 
of key AYP provisions): 

using the provision known as “safe 
harbor” by which schools may be 
considered as having met AYP if 

the schools have significantly decreased the percentage of students not proficient; 

establishing a minimum number of students (“minimum «”) in a subgroup needed to constitute a 
subgroup for inclusion as a separate group in AYP determinations; 

applying a confidence interval or standard error of measurement to account for sampling error 
or measurement error; 

providing guidelines to ensure schools are held accountable only for students receiving 
instruction at the same school for a full academic year; 

averaging data over time, whether for proficiency or participation rates; 

setting rules for identifying schools and districts for improvement based on missing AYP in the 
same indicator for two consecutive years (reading, mathematics, other academic indicator). 

While state efforts have focused on reducing the likelihood that high-performing schools or districts are 
mistakenly counted as having not made AYP, the methods also may increase the likelihood that truly 



Exhibit 17 

Expected Achievement Growth Based on 
Different AMO Trajectory Types 
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Exhibit reads: On average, in states with a linear 
trajectory, at least 51 percent of the expected growth must 
take place between spring 2004 and spring 2009, and 
49 percent must occur between spring 2009 and spring 
2014. 

Note: Because states were not required to increase AMOs for 
the first years of NCLJ3 implementation, the calculations were 
conducted using state AMOs from 2004 through 2014. 

Sources: SSl-NCLB, Review of State Accountability Workbooks 
and SEA Web sites (« = 49 states, District of Columbia, and 
Puerto Rico). 
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low-performing schools and districts will make AYP. Analyses presented in Chapter III discuss the 
relationship between state reliability adjustments and the rates at which schools make or do not make 
AYP targets. 

Safe Harbor 

ATCU3 requires that states establish criteria and conditions that make their AYP models valid and 
reliable. NCLJ5 includes a “safe harbor” provision used by all states: schools may make AYP if the 
percentage of students scoring below proficient decreases by 10 percent from the preceding school year 
and if the school makes AYP for the relevant group or subgroup for the other academic indicator and 
participation rate. (See Appendix B, Exhibit B.5 for information on each state’s safe harbor policy.) 

Setting Minimum Sizes for Subgroups 

Under IVCLB, states are required to determine minimum sizes (“minimum «”) for groups to be included 
in calculations of AYP. Setting a minimum size reduces statistical error due to small sample size. For 
example, if a state sets a minimum n at 30 students, a school must have 30 or more students enrolled for 
a full academic year in a given 
group (e.g., LEP students) for that 
group to count separately in the 
school’s AYP calculation. States 
set the same minimum «’s for their 
schools and districts; in 2006—07, 

11 states set separate «’s for 
proficiency rates and test 
participation rates. (See Appendix 
B, Exhibits B.6 and B.7 for 
information on each state’s 
minimum n.) In 2006—07, the 
minimum n size for proficiency 
ranged from five (in Maryland) to 
50 students (in Virginia and West 
Virginia), with more than half of all 
states choosing either 30 or 40 as 
the threshold number (see Exhibit 
18). North Dakota does not have a 
minimum n size for all students, 
having established a policy of 
conducting a test of statistical 
significance instead (however, 

North Dakota has set a minimum n 
of 10 for subgroups). In the case of 
small schools whose total 
enrollment in tested grades falls 
below the overall minimum n, the 
state may determine AYP using an 
alternate, small-school AYP 



Exhibit 18 

States With Various Minimum n Sizes for Calculating 
Proficiency of the “All Students” Subgroup, 2006-07 




Exhibit reads: In 2006—07, six states adopted a minimum n size 
of 15 students or fewer for the purposes of determining proficiency 
of the “all students” subgroup for AYP. 

Note: States in which the minimum n varies by student enrollment are 
included in the category which reflects the smallest number indicated in 
their formula (30 students, for example, in the case of Florida). North 
Dakota, which does not have a minimum n size, is excluded. 

Source: SSI-NCLB, Title I Assessment and Accountability Interviews 
with Analysis of SEA Documents ( n = 49 states, the District of Columbia, 
and Puerto Rico). 
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formula. 37 In either case — subgroup or overall minimum n — the purpose is to avoid misclassifying a 
school or district based on an unreliable estimate of performance. 

Although the majority of states employed a single number as their n size, in 2006—07, 12 states had 
adopted an approach that takes into account the size of a subgroup in proportion to the total enrollment. 
For example, Florida adopted a minimum n size that largely corresponded to the overall student 
population in AYP grades. As described in Florida’s accountability workbook: “For accountability 
purposes, the minimum group size shall be at least 30 students and more than 15 percent of the total 
school population or 100 students for the subgroups for performance criteria (not participation).” 38 

As early as 2003, states requested permission to set a different minimum n size for the LEP and students 
with disabilities subgroups as for other subgroups of students. For example, a state could have set the 
minimum n for the LEP subgroup and the students with disabilities subgroup at 40, while the minimum 
n for other subgroups could be set at 30. Thus, fewer schools would be held accountable for the first 
two subgroups. However, non-regulatory guidance issued on July 20, 2007, prohibited states from 
establishing a different minimum number of students for separate subgroups. Accordingly, in 2008, nine 
states were required to amend their accountability plans to establish a uniform minimum n for all 
subgroups. 

Using Confidence Intervals 

Another strategy states use to avoid misclassifying schools is to construct a confidence interval around the 
observed percentage of students who scored proficient or above in a given year. Confidence intervals 
take into account the fact that the students tested in any particular year might not be representative of 
students in that school across the years — that is, that there is some degree of sampling error, particularly 
in schools with untested grades. A confidence interval is a statistical calculation that provides an 
estimated range of values that includes the observed performance plus an allowance for this sampling 
error. The size of that range depends upon the degree of confidence desired — for example, a 99 percent 
confidence interval will produce a larger range of acceptable scores than a 95 percent confidence interval. 
As the New Mexico State Department of Education explained: 

As the number of test scores and students diminishes so does our confidence in 
interpreting results. The U.S. Department of Education has allowed us to apply a 99% 
confidence interval. If the AYP target is 35% proficient in Mathematics, for example, 
and 101 students are tested, then the target lowers to 24.97, which is the lower bound of 
the confidence interval. This is similar to the margin of error mentioned in surveys and 
election results (“give or take 3%”). The smaller the number of scores used in an 
analysis the wider the confidence interval (margin of error). 39 



37 Under NCLJi, states are required to determine the AYP status of all schools, even those in special circumstances — 
that is, schools that are very small and do not meet the minimum n size, or schools that do not have tested grades (such 
as K-2 schools). States have developed specific strategies to ensure that such schools receive an AYP designation. In 
Alabama, for example, a school with untested grades may be linked with the school to which it feeds and will have the 
same AYP status as the receiving school. In Colorado, AYP for such schools may be determined through locally 
administered assessments. To determine AYP of small schools, Montana uses state assessment data as well as a broader, 
“qualitative review” of other performance data and information related to student achievement. Other states, such as 
New Hampshire, aggregate data from small schools across years to determine AYP. 

38 State of Florida Consolidated State Application Accountability Workbook. 

http:/ /www.ed.gov/admins/lead/account/ stateplans03/flcsa.doc (accessed October 2008). 

39 New Mexico Public Education Department Questions and Answers about Adequate Yearly Progress, 2008. 
http:/ /www.ped.state.nm.us/ayp2008/ faq.html (accessed December 2008). 



Chapter II 



41 





The use of confidence intervals is designed to reduce the likelihood that schools will be incorrecdy 
labeled as not making AYP, and by 2006—07, the majority of states (40 states and Puerto Rico) had 
received approval to apply confidence intervals to AYP calculations, most often at the 95 or 99 percent 
levels. In general, the larger the confidence interval, the more likely it is that truly low-performing 
schools will be misclassified as making AYP and the less likely it is that higher performing schools will be 
misclassified as not making AYP. (See Appendix B, Exhibit B.8 for information on each state’s use of 
confidence intervals.) 

A few other states (Hawaii, Michigan, South Carolina) apply a related statistical procedure — the standard 
error of measurement. For example, through its 2005 accountability amendment, Michigan received 
approval to apply an error band of two standard errors to each student’s score. Student scores that fall 
within this error band will be counted as proficient for AYP. 

Defining Full Academic Year 

Under NCLB, schools are held accountable for the proficiency of students who were enrolled in a 
school for a full academic year, as defined by the state. Only students enrolled for a full academic year 
are to be included in school AYP calculations for proficiency — thus, schools are held accountable for 
those students that have received a significant amount of instruction at the school, which helps to 
support the overall validity of the system. Each state defines it own full academic year. In 2004—05, state 
definitions of full academic year fell into four main categories; these general categories remained similar 
in 2006—07. The most frequendy used definition (40 states in 2004—05) was the time from a target date 
in the fall through a test date in the spring. Four states identified one specific date during the year, five 
established a minimum number of days of enrollment, and three required continuous enrollment from 
one test administration to the next (for example, spring 2003 testing through spring 2004 testing). 

In 2007, seven states requested permission to modify their definitions of full academic year — among 
these states three had also opted to move their high school assessment from the spring to the fall. One 
such modification (Michigan) entailed “basing the full academic year on two-semi-annual student count 
days — the fourth Wednesday in September and the second Wednesday in February. For schools and 
school districts, students must be enrolled for the three most recent semi-annual official count days.” 40 

Averaging Scores Over Time 

Under NCLB, states can average scores from the current year with scores from either the previous year 
or the previous two years when calculating the score that will be compared to the state performance 
target for the purposes of determining AYP. As specified in a 2004 notice from the U.S. Department of 
Education entided Charting the Course: States Decide Major Provisions under No Child Left Behind, 
“states have the flexibility to determine how many years of data will be used to make an AYP 
determination. States may use one, two, or three years of data in calculating AYP. Further, states have 
the flexibility to compare one year of data to two or three years of data in making final AYP 
determinations. This flexibility enables a state to give schools the benefit of recent improvements (with 
one year) or limit the effect of a poor achievement in one year (with two or three years).” 41 For example, 
one of Kentucky’s accountability amendments approved in 2005 clarified that “Kentucky will use multi- 
year averaging when calculating annual measurable objectives (AMOs) for reading and math. That is, if a 
school does not meet an AMO based on the current year aggregated average of the performance of 



40 U.S. Department of Education decision letter to the Michigan Department of Education, July 16, 2007. 
http:/ /www.ed.gov/admins/lead/account/letters/acmi6.html (accessed February 2007). 

41 U.S. Department of Education, Charting the course: States decide major provisions under No Child Left Behind. 
http:/ /www.ed.gov/news/pressreleases/2004/01/01142004.html (accessed December 2008). 
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elementary, middle, or high school students, the aggregated average may be computed based on the most 
recent two or three years of student performance data in reading and/ or mathematics.” 42 

Identification for Improvement 

Use of the same indicator for two consecutive years. NCLB requires that schools or districts that do not make 
AYP for two consecutive years be identified for improvement. By 2008, all states, the District of 
Columbia, and Puerto Rico specified that they would identify schools for improvement only if they 
missed AYP in the same subject or other academic indicator for two consecutive years. 

Use of all three school levels in the same content area for district identification. In 2004, 1 8 states received approval 
to limit identification of districts for improvement to those that did not make their AYP targets at each 
of the three school levels (elementary, middle, and high school) in the same content area (reading or 
mathematics) for two consecutive years. In 2005, 14 additional states were approved to do so, and in 
2006, 10 states received approval for similar amendments. For example, Louisiana was approved for the 
following: “Louisiana will identify districts for improvement only when they do not make AYP in the 
same subject or other indicator in all grade spans (i.e., elementary, middle school and high school) for 
two consecutive years. In implementing this provision, Louisiana should monitor districts that have not 
made AYP in one grade span but have not been identified for improvement to ensure they are making 
the necessary curricular and instructional changes to improve achievement.” 43 

Definition of a “new” or “restructured” school. For accountability purposes, states may be compelled to 
determine when a school can legally qualify as a new school. For example, a school in restructuring 
status that experiences significant change in the school population may seek to “reset” the accountability 
timeline. Likewise, normal population shifts many propel districts to consolidate existing schools, calling 
their accountability designation into question. To address these issues, two states sought accountability 
amendments to clarify their definition of a new school in 2006; while three states did so in 2007 and six 
in 2008. For example, Iowa clarified that “a school is considered a ‘new’ school if there is an increase or 
decrease in the enrollment (due to realignment of grade structures) of at least 50 percent compared to 
the previous year. In such situations, the timeline for being identified for improvement will start over.” 44 
Similarly, in 2008 New Jersey “established the following criteria to recognize a restructured school as 
new: 1) the restructured school must now serve grade levels that are at least 50 percent different than the 
grade levels the school previously served; and 2) the school's staff must include 50 percent more new 
staff members.” 45 

Including Growth Measures in AYP 

Although NCLB requires that all students reach the proficient level or above in reading and mathematics 
by the year 2014, the question of how best to measure progress toward state and national proficiency 
goals has prompted analysis and debate since the law’s initial passage. Each district and school is 
expected to make AYP towards proficiency for all students collectively and for each identifiable 
subgroup of students. Under the current structure of the law, progress is defined by the percentage of 
students achieving at or above the proficiency level for that particular year. So long as the proficiency 



42 U.S. Department of Education decision letter to the Kentucky Department of Education, August 15, 2005. 
http:/ /www.ed.gov/admins/lead/account/letters/acky4.html (accessed December 2008). 

43 U.S. Department of Education decision letter to the Louisiana Department of Education, August 2, 2006. 
http:/ /www.ed.gov/admins/lead/account/letters/acla6.html (accessed February 2007). 

44 U.S. Department of Education decision letter to the Iowa Department of Education, May 18, 2007. 
http:/ /www.ed.gov/admins/lead/account/letters/acia6.htm (accessed December 2008). 

45 U.S. Department of Education decision letter to the New Jersey Department of Education, July 16, 2008. 
http:/ /www.ed.gov/admins/lead/account/letters/acnj9.html (accessed December 2008). 
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levels within a school meet or exceed these state-defined annual objectives, the school is determined to 
have made AYP, even if the overall level of achievement actually declined. In fact, some schools that 
significantly raise student achievement scores would still not meet AYP if they do not meet all state 
proficiency targets, although such a school may make AYP through the safe harbor provision. 

Many education stakeholders have argued that the current approach to AYP (sometimes referred to as 
the “status model”) does not adequately recognize progress made by schools that begin with large 
numbers of low-performing students. To better gauge the academic growth of individual students, 
numerous groups, including the National Conference of State Legislatures, the Council of Chief State 
School Officers, and the American Association of School Administrators, issued statements 
championing the use of growth-based accountability models as an alternative or valuable addition to the 
status model of progress. (NCSL, 2005; Olson, 2004; Schwartzbeck, 2005). In response to the 
considerable support for acknowledging student growth in AYP determinations, U.S. Secretary of 
Education Margaret Spellings announced the creation of the Growth Model Pilot Program in November 
2005. This program initially allowed up to ten states to implement newly designed accountability models 
that incorporate growth models into state accountability systems. In December 2007, Secretary Spellings 
announced that the growth model program would be open to “all eligible states.” 46 

The Department implemented a two-stage review process to ensure an objective and transparent 
selection process for all participating states. To be considered, states must first demonstrate how their 
growth model proposal meets a set of core principles outlined by the U.S. Department of Education. 
These principles require that states: 

• establish annual growth targets to ensure that all students are proficient by 2013—14, and that the 
achievement gap is closing among all student subgroups; 

• set expectations for annual achievement based on meeting grade -level proficiency, and not on 
student demographics or school characteristics; 

• set separate achievement goals for reading language arts and mathematics; 

• include all schools and districts in the assessment and accountability system; 

• have at least two years of disaggregated student assessment data for grades 3—8 and in high 
school in reading language arts and mathematics, and produce comparable results from grade to 
grade and year to year; 

• have the data capacity to track individual student progress from year to year; and 

• include student participation rates and student achievement on an additional academic indicator 
in the state accountability system. 

States proposals were reviewed by a panel of nationally recognized experts. As of December 2007, nine 
states had approved growth model proposals: North Carolina, Tennessee, Delaware, Arkansas, Florida, 
Iowa, Ohio, Alaska, and Arizona. In June 2008, Michigan and Missouri’s growth model proposals were 
approved, and in January 2009, the growth models of Minnesota, Colorado, Pennsylvania, and Texas 
were approved. 



46 “Secretary Spellings Invites Eligible States to Submit Innovative Models for Expanded Growth Model Pilot.” 
http:/ /www.ed.gov/news/pressreleases/2007/ 12/ 12072007.html (accessed October 2008). 
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State Accountability Systems Beyond NCLB 



Many states established systems of accountability in the 1990s, prior to NCLB, and some have 
maintained these prior initiatives after NCLB implementation. The presence of dual accountability 
systems was noted during the IAS A era (Goertz and Duffy, 2001; O’Day, 1999), when many states had a 
system that applied to all schools as well as a Title I system charting the AYP of schools that received 
Title I funds. NCNB was intended to reconcile these systems, and states have worked to integrate state 
accountability practices with new federal requirements. 

By 2006-07, a total of 27 states had accountability requirements that went beyond, 
or were used in addition to, what is required of these states under NCLB. 

By 2006—07, three states phased our their pre-NCLB systems, and six states had added new 
accountability provisions in addition to what is required under NCLB. One other state reported plans to 
implement an accountability system beyond NCLB in 2007—08. States that developed systems since the 
passage of NCLB indicated that they were building on the NCNB requirements to make more coherent 
statewide systems that incorporated local priorities. One official, whose state is considering adding 
accountability requirements beyond NCNB explained, 

“We are investigating having a state accountability piece to coexist with AYP but we 

don’t have it in place right now [Wje’re interested in including all of our assessments 

like our writing, our science, a few other things in an accountability system that are not a 

part of AYP We have five subject areas that students are required to pass to get a 

diploma. We would like somehow to include that, the students passing all five in the 
accountability some way. So. . . there are assessment data and other things that we think 
are important to include in an accountability system that NCLB does not include.” 

In 2006—07, all state accountability programs that went beyond NCLB used designations of school 
performance that differed somewhat from those of NCLB or reported their results in different ways. 

For example, some used letter grades, others identified “high-improving” schools, and so forth. Another 
notable difference was that many state programs (1 5) relied on growth measures to track progress toward 
accountability targets instead of an absolute target (percent reaching a set proficiency level) as in NCNB. 
As one state official explained, his state system was designed to hold schools accountable for the 
performance of students below proficiency, as well as above, “It’s not good enough to just have students 
meet the standard. For those students who are meeting the standards, [we want to know] what are 
schools doing to help them be performance level four or five years in the future. And then for students 
who are below the bar, what are schools doing? AYP focuses so much on students below the bar that 
we wanted to make sure that we were not losing and not forcing schools to not pay attention to those 
other students.” 

Fourteen states used different (or additional) measures of student achievement in their state 
accountability system (for example, tests in subjects not required under NCLB), and two had different 
inclusion rules for LEP students. As a result of these alternate measures, 15 states that maintain their 
pre-NCLB accountability programs reported that different schools were identified for improvement 
under NCLB than those identified under the state’s other initiative. Of the six states with post-NCLB 
accountability systems, four states identified different schools for improvement under the state system 
than under NCNB. 
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Earlier in the implementation of NCLB, observers reported tensions between the prior state 
accountability systems and the newer, less familiar NCLB accountability requirements, particularly with 
respect to the identification of low-performing schools based on AYP. For example, in some cases, state 
accountability designations from spring 2003 testing differed from AYP determinations for the same 
schools. Reportedly, some schools that did not make AYP targets received high marks under the state 
system (Hoff, 2004). 47 

NCLB and other state or district accountability initiatives did not commonly 
generate conflicting designations of high- and low-performing schools, according to 
principal reports for 2004-05. 

In 2006—07, such discrepancies appeared limited. For example, only 2 percent of schools that were 
identified for improvement under NCLB were identified as high-performing under a state or district 
accountability system. Conversely, only 3 percent of schools that were not identified by the NCLB 
system received a separate state designation as low-performing (see Exhibit 19). 



Exhibit 19 

Percentage of Schools Identified and Not Identified for Improvement Under NCLB, by 
Accountability Designations Under State or District Accountability Initiatives, 2006-07 


Designation Under State or District Accountability 
Initiative 


Schools Identified 
Under NCLB 

(n= 469) 


Schools Not Identified 
Under NCLB 

(n =918) 


Low-performing 


34% 


3% 


No special designation 


11% 


33% 


High-performing 


2% 


18% 


Other/not sure 


14% 


9% 


No other system (other than NCLB) 


39% 


37% 


Exhibit reads: Thirty-four percent of schools identified for improvement under NCLB were also 
designated as low-performing under a state or district accountability system. 


Note: Analysis includes principal survey respondents in jurisdictions that had a state or distnct accountability initiative 
in 2006-07. 


Source: NLS-NCLB, Principal Surveys. 







47 See Linn (2005) for a more extensive discussion of differences between pte-NCLB state accountability provisions and 
NCLB requirements. 
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Overall, most respondents reported success in incorporating NCLB requirements 
into state systems, but over one-third of district officials and principals believed that 
this additional system resulted in staff confusion about targets. 

In 2006—07, a majority of both district administrators and principals agreed that having a state or district 
program in addidon to NCLB gives a more complete picture of effectiveness. Nearly three-quarters of 
district officials also agreed that having a state or district accountability program also helped to make 
effective decisions about student achievement. Nonetheless, over one-third of district officials and 
principals believed that this additional system resulted in staff confusion about targets, 48 and about 
one-fifth believed that the dual system reduced community support for public schools (see Exhibit 20). 

By 2006—07, state officials reported that they had managed to integrate NCLB requirements with state 
accountability initiatives and had reconciled conflicts that were apparent earlier in the NCLB 
implementation process. As one state official commented, “the [state level staff] really work hard to 
make sure the two systems are integrated and that they support each other and are not at odds.” 



Exhibit 20 

Perceived Benefits and Drawbacks of Having State and/or District Accountability 
Initiatives in Addition to NCLB, in Districts and Schools That Report Having Them, 

2006-07 


Perceived Benefit and Drawback 


Percent of 
Districts 
Agreeing 

(n = 154) 


Percent of 
Schools 
Agreeing 

(n = 832) 


Gives us a more complete picture of our effectiveness than a single accountability system 


69% 


65% 


Results in staff confusion about our targets for student achievement 


46% 


37% 


Reduces community support for public schools 


23% 


24% 


Allows us to focus on the goals that are most important to us 


56% 


52% 


Helps us make effective decisions about how to improve student achievement 


71% 


60% 


Exhibit reads: Sixty-nine percent of district administrators agree that having a dual accountability system 
gives a more complete picture of effectiveness than a single accountability system. 

Source: NLS-NCLB, District and Principal Surveys. 



Discussion 

Three themes are apparent in state policy responses to the standards, assessment, and improvement 
targets required by NCLB. 

First, by 2006—07, states had made substantial progress toward compliance with NCLB accountability 
requirements. For the most part, the standards, assessments and AYP provisions had been established, 



48 See Bitter et al. (2005) for an analysis of similar reported confusion among low-performing schools identified in the 
Immediate Intervention/Underperforming Schools Program in California. 
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often (though not always) within the time frame stipulated in the law. This is particularly true in the 
areas in which states had prior compatible policies, such as previously established standards and 
assessments in reading and mathematics. 

Second, states displayed variation in the specifics of their policies — from setting academic achievement 
standards in reading and mathematics to issues of reliability and assessment of LEP students. In 
comparison to a nationwide benchmark, the 2005 National Assessment of Educational Progress 
(NAEP), state NCL& academic achievement standards for proficiency in grade 8 mathematics ranged 
from a low NAEP equivalent score of 230 to a high NAEP equivalent score of 31 1, a difference of 
72 points. This variation must be taken into account in any cross-state or national examination of the 
number and percentages of schools that make AYP, as discussed in Chapters III and IV of this report. 

Third, the resulting state accountability systems reflect complex and changing policy choices. In 
2006—07, states were continuing to refine and adopt new standards, assessments, and AYP procedures 
as new requirements and flexibility were announced. In addition, where prior state accountability 
programs were well established and differed from NCUi requirements, states made a number of 
adjustments to integrate the two approaches into a single system. While a majority (65 percent) of 
school principals believed that the combination of state and federal accountability programs provided 
a more complete picture of school effectiveness, a large minority believed that this combination 
resulted in staff confusion about targets. 

Thus, as states make — and revise — choices about the interconnected elements of NCUi accountability, 
they create complicated policies that are unique from state to state. 
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III. MEETING AYP TARGETS: RESULTS FROM EVOLVING 

SYSTEMS 

Under NCLB, each state must establish a definition of adequate yearly progress (AYP) that is used to 
determine the annual status of each public school and school district. To make AYP, schools and 
districts are required to meet their state’s performance targets for all students and for each required 
subgroup of students 49 in reading and mathematics, test participation, and one other academic indicator. 
Schools and districts that do not make AYP for two consecutive years are identified for improvement 
and receive the supports and interventions associated with that status. This chapter primarily presents 
information on schools and districts that reflects the AYP status of schools for 2005—06. 



Key Findings 

• Approximately three-quarters of the nation’s schools and districts made AYP in 
2005—06, nearly identical proportions as in 2003—04 and 2004—05. The proportion of 
schools that made AYP varied across states, ranging from less than 30 percent in two states 
to 90 percent or more in five states. 

• Stable national rates of making AYP over the past three years mask the fact that 
some states’ rates of making AYP rose substantially while others’ rates fell 
substantially. Seven states’ proportions of schools making AYP rose by more than 
10 percent from 2003—04 to 2005—06. 

• High-poverty, high-minority and urban schools continued to be less likely to make 
AYP in 2005—06. Schools that were held accountable for greater numbers of subgroups, 
secondary schools, and large schools were also less likely to make AYP. 

• More than half of the schools that did not make AYP in 2005—06 missed because 
either the “all students” group or two or more student subgroups did not meet 
achievement targets. About one-quarter of schools that did not make AYP, missed targets 
for one subgroup only. The pattern of targets missed by schools that did not make AYP has 
been stable over the past three years. 

• Four-fifths of schools had the same AYP designation in 2005—06 as in 2004—05. 

Two-thirds (65 percent) made AYP in both 2004—05 and 2005—06, and 16 percent did not 
make AYP in both years. 



State definitions of AYP have evolved as the law has been in force over the past several years (Forte and 
Erpenbach, 2006). The Department of Education has provided additional flexibility concerning AYP 
determinations for LEP students and students with disabilities. 50 As discussed in Chapter II, states have 



49 The eight student subgroups in standard use in the state-reported data were: (1) white, (2) African-American, 

(3) Hispanic, (4) Asian, (5) American Indian, (6) students with disabilities, (7) students from low-income families, and 
(8) limited English proficient students. 

50 Flexibility for LEP students, which became effective in February 2004, allows states to exempt LEP students in their 
first year of enrollment in U.S. schools from taking an English language proficiency assessment instead of the state 
reading assessment, exclude those students’ reading and mathematics scores from AYP calculations, and retain formerly 
LEP students in the LEP subgroup for AYP calculations for up to two years after they attain English proficiency (final 
regulations codifying this flexibility were published in September 2006). Flexibility for students with disabilities, 
announced in May 2005, allows eligible states to make adjustments to their AYP decisions to reflect the need for 
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also adjusted the AYP definitions and their procedures for calculating AYP (e.g., increases in the 
minimum n size for subgroups, expanded use of confidence intervals, and a growth models pilot 
program). The results presented in this chapter reflect the effect of changes in states’ implementation of 
AYP that were in effect in 2005—06. The 2005—06 results presented in this chapter only reflect the use 
of growth models in the two states that had been approved to use growth models in that year — North 
Carolina and Tennessee. 

School and District Adequate Yearly Progress 

Approximately three-quarters of the nation’s schools and districts made AYP in 
2005-06, nearly identical proportions as in 2003-04 and 2004-05. 

In 2005—06, 73 percent of the nation’s schools met all applicable AYP targets as defined by their states — 
compared to 75 percent in 2003-04 and 74 percent in 2004-05. 51 Seventy-one percent of districts made 
AYP in 2005—06, holding steady from 71 percent in 2003—04 and 72 percent in 2004—05. 

States varied greatly in the proportion of schools and districts that made AYP. 

The proportion of schools that made AYP in 2005—06 ranged from 95 percent of schools in Wisconsin 
to 14 percent of schools in the District of Columbia (see Exhibit 21). In five states, 90 percent or more 
of schools made AYP, while less than 30 percent of schools made AYP in two states. Similarly, the 
proportion of districts that made AYP ranged from 100 percent of districts in Alabama, Michigan, and 
Wisconsin, to less than 10 percent of districts in Florida, North Carolina, South Carolina and West 
Virginia. 52 This variability across states does not necessarily imply great variation in student 
performance; rather, it may reflect the variation in states’ implementation of the NCLB accountability 
requirements (see Chapter II). For example, states used different proficiency standards for their 
assessments. Forty-two percent of middle schools made AYP in 2004—05 in the eight states that had the 
highest proficiency standards in eighth-grade mathematics (using NAEP to benchmark the states against 
a common metric as described in Chapter II), compared with 65 percent of middle schools in the eight 
states that had the lowest proficiency standards relative to NAEP. Findings were similar for 
fourth-grade mathematics, fourth-grade reading, and eighth-grade reading. States also set different 
trajectories of annual measurable objectives for reaching the goal of 100 percent proficiency in 2013—14. 
Furthermore, states varied in their use of other academic indicators (e.g., writing assessments rather than 
attendance rates). Minimum student subgroup sizes varied across states as well; some states counted 
smaller student subgroups for AYP than did other states, and, as a result, schools in these states were 
likely to have more subgroup targets to meet. 



modified achievement standards for students with disabilities who may not be able to reach grade-level standards in the 
same timeframe as other students. In December 2005, the U.S. Department of Education published a notice of 
proposed rulemaking to permit states to adopt modified achievement standards and assessments for certain students 
with disabilities; the Department issued final regulations on modified achievement standards and assessments based on 
those standards in April 2007. 

51 The SSl-NCLB National AYP and Identification Database contains 87,892 schools for 2003-04, 89,828 schools for 
2004-05, and 87,896 schools for 2005-06 with valid AYP statuses located in approximately 15,000 districts across 

50 states, the District of Columbia, and Puerto Rico. 

52 For percentage of districts that made AYP by state, see Appendix C, Exhibit C.l. 
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Exhibit 21 

Percentage and Number of Schools That Made AYP, by State, 2005-06 


States 


Percent 

making 

AYP 


Number 

making 

AYP 


States 


Percent 

making 

AYP 


Number 

making 

AYP 


States 


Percent 

making 

AYP 


Number 

making 

AYP 


Total 


73% 


63,847 


Kentucky 


66% 


799 


Ohio 


61% 


2,349 


Alabama 


88% 


1,195 


Louisiana 


89% 


1,048 


Oklahoma 


90% 


1,545 


Alaska 


38% 


308 


Maine 


75% 


380 


Oregon 


70% 


856 


Arizona 


67% 


1,244 


Maryland 


77% 


1,035 


Pennsylvania 


83% 


2,539 


Arkansas 


61% 


674 


Massachusetts 


59% 


1,043 


Puerto Rico 


44% 


698 


California 


66% 


6,297 


Michigan 


92% 


2,720 


Rhode Island 


66% 


191 


Colorado 


72% 


1,202 


Minnesota 


74% 


1,291 


So. Carolina 


40% 


420 


Connecticut 


66% 


643 


Mississippi 


84% 


714 


So. Dakota 


83% 


591 


Delaware 


82% 


157 


Missouri 


70% 


1,465 


Tennessee 


82% 


1,302 


D.C. 


14% 


25 


Montana 


84% 


407 


Texas 


92% 6,51 6 


Florida 


28% 


855 


Nebraska 


83% 


680 


Utah 


84% 


791 


Georgia 


79% 


1,612 


Nevada 


64% 


367 


Vermont 


76% 235 


Hawaii 


35% 


100 


New Hampshire 


59% 


274 


Virginia 


83% 1 ,509 


Idaho 


66% 


409 


New Jersey 


72% 


1,583 


Washington 


84% 


1,736 


Illinois 


82% 


2,942 


New Mexico 


47% 


371 


West Virginia 


86% 


604 


Indiana 


49% 


888 


New York 


74% 


3,290 


Wisconsin 


95% 2,047 


Iowa 


84% 


1,269 


North Carolina 


44% 


924 


Wyoming 


85% 


296 


Kansas 


83% 


1,019 


North Dakota 


91% 


392 








Exhibit reads: Based on testing during the 2005—06 school year, 63,847 schools made AYP representing 
73 percent of all schools (including Title I and non— Title I schools) 

Source: SSl-NCLB, National AYP and Identification Database (based on data reported by 50 states, the District of 
Columbia, and Puerto Rico for 87,896 schools in these states). 



Stable national rates of making AYP from 2003-04 to 2005-06 mask the fact that 
some states’ rates of making AYP rose substantially while other states’ rates fell 
substantially. 



Although the national rate of making AYP remained stable from 2003—04 to 2005—06, states moved in 
different directions. The share of schools that made AYP rose by more than 10 percent in seven states, 
while in 15 states, this share dropped by more than 10 percent from 2003—04 to 2005—06 (see Exhibit 
22 ). 

By reviewing state accountability workbooks and interviewing state officials, we identified a variety of 
reasons why the percentage of schools making AYP rose more than 10 percent between 2003—04 and 
2005—06 in these seven states. Illinois and Oklahoma revised their definitions of AYP by widening the 
confidence intervals applied to AYP and safe harbor calculations. Illinois, Michigan, and Virginia 
increased their minimum n for subgroups between 2003—04 and 2005—06. Alabama reported that the 
state was allowed to count a “partially proficient” student as half a proficient student in AYP calculations 
beginning in 2005—06 but attributed the rest of the improvement in the percentage of schools making 
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AYP to hard work at the local level and students’ increased familiarity with open-ended and gridded- 
response test item formats. West Virginia attributed the increase in the percentage of schools making 
AYP to an increasingly strong state capacity to respond to and assist with assessment and accountability 
measures through staff development, programs, and audits. South Dakota reported that the introduction 
of new standards and a new assessment in mathematics in 2005—06 made comparison across years 
ambiguous. 



Exhibit 22 

States With the Largest Changes in the Percentage of Schools That Made AYP, 

2003-04 to 2005-06 



States 


Number of Schools Making 
AYP 


Percent of Schools Making AYP 


Percentage 

Point 




2003-04 


2004-05 


2005-06 


2003-04 


2004-05 


2005-06 


Change 


Rose more than 10 percentage points 












Alabama 


319 


729 


1,195 


23% 


43% 


88% 


+55% 


Illinois 


2,712 


2,775 


2,942 


71% 


74% 


82% 


+11% 


Michigan 


2,745 


2,729 


2,720 


77% 


92% 


92% 


+15% 


Oklahoma 


1,315 


1,756 


1,545 


75% 


97% 


90% 


+15% 


South Dakota 


485 


589 


591 


67% 


82% 


83% 


+16% 


Virginia 


1,356 


1,347 


1,509 


72% 


75% 


83% 


+11% 


West Virginia 


504 


580 


604 


72% 


83% 


86% 


+14% 


Dropped more than 10 percentage points 












Arizona 


1,446 


1,561 


1,244 


83% 


87% 


67% 


-1 6% 


Arkansas 


801 


595 


674 


77% 


58% 


61% 


-16% 


Connecticut 


786 


786 


643 


81% 


80% 


66% 


-1 5% 


District of Columbia 


64 


81 


25 


41% 


47% 


14% 


-27% 


Hawaii 


147 


94 


100 


52% 


34% 


35% 


-17% 


Idaho 


596 


346 


409 


84% 


57% 


66% 


-18% 


Indiana 


1,340 


1,085 


888 


75% 


59% 


49% 


-26% 


Massachusetts 


1,259 


1,239 


1,043 


72% 


71% 


59% 


-1 3% 


New Hampshire 


318 


na 


274 


71% 


na 


59% 


-12% 


New Mexico 


519 


372 


371 


68% 


47% 


47% 


-21% 


North Carolina 


1,608 


1,317 


924 


71% 


58% 


44% 


-27% 


Ohio 


3,244 


2,982 


2,349 


83% 


76% 


61% 


-22% 


Rhode Island 


259 


na 


191 


83% 


na 


66% 


-17% 


South Carolina 


582 


502 


420 


56% 


48% 


40% 


-1 6% 


Vermont 


272 


na 


235 


89% 


na 


76% 


-1 3% 



Exhibit reads: In Alabama, the number of schools that made AYP rose from 319 in 2003—04 to 
1,195 in 2005—06, and the percentage of schools making AYP rose from 23 percent in 2003—04 to 88 
percent in 2005-06, an increase of 55 percentage points. 

Notes: “na” means not available. Comparable 2004—05 AYP data are not available for New Hampshire, Rhode 
Island and Vermont due to a change in their accountability testing. 

Source: SSl-NCLB, National AYP and Identification Database (based on data reported by 50 states and the 
District of Columbia for 87,896 schools in these states). 



In nine of the 1 5 states where the percentage of schools making AYP dropped more than 1 0 percent 
between 2003—04 and 2005—06, the drop in the rate of schools making AYP was likely to be associated 
with an increase in their AMOs. In five of these states, state officials directly attributed the drop in the 
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percentage of schools making AYP to an increase in annual targets. As one official explained, “The 
targets have to be adjusted every couple years and they just went in [effect]. The target, of course, means 
that more schools will fail, have failed so far.” For example, AMOs increased between 2003—04 and 
2004-05 in Hawaii (from 30 percent to 44 percent in reading and from 10 percent to 28 percent in 
mathematics), Indiana (from 59 percent to 66 percent in reading and from 57 percent to 64 percent in 
mathematics) and Idaho (66 percent to 72 percent in reading and 51 percent to 60 percent in 
mathematics) but remained stable between 2004—05 and 2005—06. Other states such as Massachusetts 
experienced an increase in AMOs between 2004-05 and 2005-06 (from 76 percent to 81 percent in 
reading and from 61 percent to 69 percent in mathematics). 

Officials in the other six states reported that decreases in the percentage of schools making AYP were 
associated with an increase in the number of tested grades and therefore the calculation of AYP for a 
greater number of student subgroups (New Mexico and Ohio), a change in proficiency cut scores 
(North Carolina), or the phasing in of new tests (New Hampshire, Rhode Island, and Vermont). 

The role of state accountability policy in AYP results 

Changes in state policies from year to year can influence the percentage of schools that make AYP. State 
definitions of AYP have many moving parts, making it very difficult to determine which policy changes 
are responsible for changes in the rates at which schools make AYP. The analyses in this section are not 
causal but do examine the association between certain state policies and practices and changes in the 
percentage of schools making AYP. Specifically, we examine three types of state policy changes: 
increases in AMO targets, AYP features approved to increase the reliability of AYP determinations, and 
the use of the 2 percent proxy for students with disabilities. 53 

In states where AMO targets rose from 2004-05 to 2005-06, there was a slight 
decline in the percentage of schools making AYP, while in states with unchanged or 
reduced AMO targets, the percentage of schools that made AYP remained 
unchanged. 

Looking across three years of accountability data, states with increases in AMO targets were more likely 
to have experienced a decline in the number of schools that made AYP. From 2003—04 to 2004—05, the 
states in which AMO targets increased (43 states and Puerto Rico) showed a slight decline in the 
percentage of schools that make AYP, from 77 percent to 75 percent. In contrast, in states in which the 
AMO targets remained the same from 2003—04 to 2004—05, the percentage of schools making AYP rose 
from 65 percent to 76 percent. From 2004—05 to 2005—06, 16 states and the District of Columbia had 
increases in AMO targets, while 32 states and Puerto Rico had the same AMO targets in both years, and 
two states had AMO targets for 2005—06 that were lower than in 2004— 05. 54 In states where AMO 
targets increased in 2005—06, there was a slight decline in the percentage of schools that made AYP, 
from 71 percent in 2004—05 to 68 percent in 2005-06. In contrast, in states where the AMO targets 
declined or remained the same as in the prior year, the percentage of schools making AYP was 
76 percent in both 2004—05 and 2005-06. 

The results of the interim policy of using a 2 percent proxy for the students with 
disabilities subgroup varied greatly by state. 



53 Additional policy changes took place during the time period that was analyzed. For example, states were first required 
to test students in all grades 3-8 in 2005-06, so some states added grades to their assessments during this period. 

54 The lower AMO targets were associated with the adoption of new assessments. 
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In May 2005, the U.S. Department of Education offered three interim policy options for states prior to 
the release of federal guidance on modified achievement standards. The first of these options, known 
generally as the 2 percent proxy option, was available only to schools and districts that did not make 
AYP solely for the achievement of students with disabilities. In order to be eligible to use the 2 percent 
proxy, states had to show the Department that the performance of students with disabilities in that state 
was improving. In general, eligible states could calculate a proxy to determine the percentage of special 
education students that was equivalent to 2 percent of all students assessed. The proxy was then added 
to the percentage of students with disabilities who were considered proficient. This adjusted percentage 
was what a state could use to determine if the school made AYP. The other policy options included use 
of an alternate assessment based on modified standards (option 2) or a method proposed by states 
(option 3). 

Twenty-five states chose the first option of applying the 2 percent proxy for 2004-05 AYP calculations. 
Twelve states chose either option 2 or option 3 and 15 other states did not use any of the three policy 
options. 55 Note that these policy options were only available to states for calculating AYP based on 
2004—05, 2005—06 and 2006—07 testing, and were incorporated into regulations allowing their use 
through 2008—09. 

Across the 28 states with available longitudinal AYP data, both states using the 2 percent proxy and 
states using other policy options generally experienced a decline in the percentage of schools not making 
AYP due solely to the students with disabilities subgroup (Elledge et al., 2008). Among the 13 states 
using the 2 percent proxy that were able to provide data, 8 percent of schools that did not make AYP 
missed targets only for the students with disabilities subgroup in 2004—05, down from 13 percent in 
2003—04. Nine of the 1 3 states reduced their percentage of schools that did not make AYP only for the 
students with disabilities subgroup. 56 Similarly, among the four states with longitudinal AYP data that 
used policy options 2 or 3, the proportion of schools that did not make AYP only for students with 
disabilities declined from 17 percent in 2003—04 to 13 percent in 2004—05. Looked at another way, 
almost two-thirds (64 percent) of the schools that did not make AYP only for the students with 
disabilities subgroup in 2003—04, made AYP for that subgroup in 2004—05 in the states that used one of 
the three policy options, compared with about half (53 percent) of schools in states that did not use any 
of the three policy options (Elledge et al., 2008). In sum, states generally experienced a decline in the 
percentage of schools that did not make AYP solely for the students with disabilities subgroup, but the 
effects of the interim policy of using the 2 percent proxy and other policy options are ambiguous 
because not all states experienced a decline and there were several other contemporaneous policy 
changes for which these analyses do not control. 

School demographics and AYP results 

High-poverty, high-minority, and urban schools continued to be less likely to make AYP 
in 2005-06. 

In 2005—06, schools with higher proportions of low-income and minority students were less likely to 
make AYP than schools with lower proportions of such students (see Exhibit 23), as was the case in the 



55 Note that to take advantage of these policy options, states must have fulfilled specific core requirements of NCLB, 
including participation rates above 95 percent, appropriate accommodations, and subgroup size for students with 
disabilities equal to that of the overall group size. Thus, not all states were in a position to request this flexibility. 

56 Only eight of these states could report the number of schools in 2004—05 that initially did not make AYP for the 
students with disabilities subgroup only but made AYP after application of the 2 percent proxy. Of these states, the 
number of schools ranged from no schools in Delaware, North Dakota, and Tennessee to 150 schools in Florida. 
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previous two years. Fifty-seven percent of schools at the highest poverty level made AYP. The 
percentage increased to 70 percent and, subsequently, 83 percent as the level of poverty decreased. 
Similarly, 54 percent of schools with high concentrations of minority students made AYP, compared 
with 84 percent of schools with low concentrations of minority students. Sixty- two percent of schools in 
central cities made AYP, compared with 76 percent of schools in urban fringe areas and large towns and 
80 percent in rural areas and small towns. 



Exhibit 23 

Percentage of Schools Making AYP, by School Poverty Level, Minority Level, 

and Urbanicity, 2005-06 



School 

Poverty 

Level 




B3% 



School 

Minority 

Level 



75 percent or greater minority 



54% 



25 to <75 percent minority 



71% 



0 to < 25 percent minority 



84% 



Urbanicity 




0% 20% 40% 60% 80% 



100 % 



Percentage of Schools 

Exhibit reads: Fifty-seven percent of schools with more than 75 percent of students from low- 
income families made AYP in 2005—06. 



Source: SSl-NCLB, National AYP and Identification Database and Common Core of Data (based on data 
reported by 50 states, the District of Columbia, and Puerto Rico for 90,309 schools in these states). 



Secondary schools and larger schools continued to be less likely to make AYP. 

As in prior years, in 2005—06 middle and high schools were less likely to make AYP than elementary 
schools and, at each level, larger schools were less likely to make AYP than smaller schools (see 
Exhibit 24). Eighty-one percent of elementary schools made AYP, compared with 59 percent of middle 
schools and 66 percent of high schools. Smaller schools were much more likely to make AYP than 
larger schools. For instance, 75 percent of middle schools with enrollments of 400 or fewer students 
made AYP compared with 48 percent of middle schools with 801 or more students. 

Schools that were accountable for greater numbers of subgroups continued to be less 
likely to make AYP in 2005-06. 

AYP may be calculated for up to eight student subgroups: up to five state-determined major racial and 
ethnic groups, economically disadvantaged students, students with disabilities, and LEP students. States 
define a minimum subgroup size that must be met before AYP is calculated for a subgroup in a school 
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or district. Schools with larger and more diverse student populations can be expected to have more 
subgroup targets, and, therefore, can be expected to be less likely to make AYP. However, the analyses 
presented here could not determine whether the number of subgroups is actually a determinant of AYP. 



Exhibit 24 

Percentage of Schools Making AYP, by School Grade Level and School Size, 2005-06 



Elementary 

Schools 

81 % 





200 or fewer students 


80 % 




200-400 students 


64 % 


401-600 students 


60 % 



601-800 students 



74 % 



801 or more students 



66% 



Middle 

Schools 

58 % 



High 

Schools 

66% 




75 % 



400 or fewer students 
401-800 students 
801-1,600 students 



57 % 



75 % 

73 % 



1 ,601 or more students 



47 % 



0 % 20 % 40 % 60 % 60 % 



100% 



Percentage of Schools 



Exhibit reads: Eighty-one percent of elementary schools made AYP in 2005—06. Ninety percent of 
small elementary schools (with enrollments of 200 or fewer students) made AYP in 2005—06, compared 
with 66 percent of large elementary schools (with enrollments of 801 or more students). 

Source: SSI-NCLB, National AYP and Identification Database and Common Core of Data (based on data reported 
by 50 states, the District of Columbia, and Puerto Rico for 84,643 schools in these states). 



As in previous years, schools with more student subgroups were less likely to make AYP in 2005—06 
than schools with fewer subgroups. Among schools for which AYP was calculated for six or more 
subgroups, 66 percent made AYP, compared with 93 percent of schools for which AYP was calculated 
for one subgroup. Even after controlling for the level of poverty, schools with more subgroups were 
less likely to make AYP (see Exhibit 25). 57 At every level of poverty, schools with six or more student 
subgroups made AYP at a rate 17 to 28 percent lower than those with only one subgroup. 



57 This analysis uses the SSI-IVCLB national database to replicate an analysis of AYP in California conducted by Novak 
and Fuller and reported in Table 1 of the Policy Analysis for California Education (PACE) brief, Penalising Diverse Schools ? 
(Novak and Fuller, 2003). 
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Exhibit 25 

Percentage of Schools That Made AYP, by School Poverty Level and 
Number of Subgroups, 2005-06 



0 to <35 
Percent 
Poverty 



j 



1 subgroup 


2 subgroups 




BB% 


3 subgroups 


73% 





4 subgroups 


| 66% 


5 subgroups 


65% 


G or more subgroups 


□ 


73% 



35 10 <75 
Percent 
Poverty 



75 Percent 
or Greater 
Poverty 





1 subgroup 




2 subgroups 




62% 




3 subgroups 


62% 




4 subgroups 


50% 




5 subgroups 44% 






6 or more subgroups 


4B% 





1 subgroup 


2 subgroups 




3 subgroups 


50% 



67% 

88 % 



4 s 



5s 



6+ subgroups 



40% 



0% 20% 40% 60% 80% 

Psrcerriage of Schools 



100 % 



Exhibit reads: Among schools with poverty levels below 35 percent, schools for which AYP was 
calculated for only one subgroup were much more likely to make AYP (97 percent) than were schools 
where AYP was calculated for six or more subgroups (73 percent). 

Sources: SSl-NCLB, National AYP and Identification Database and Common Core of Data (based on data reported 
by 45 states and the District of Columbia for 69,195 schools in these states). 



Inclusion of student subgroups in AYP determinations 

Not all schools have AYP calculated for all of the possible subgroups listed in iVCLB. In some cases, a 
school may have no students in a particular subgroup, while other schools may have a small number of 
students such that they do not meet the “minimum n size” established by their state for AYP 
calculations. Calculating AYP for small subgroups is problematic because the results may be unreliable 
and fluctuate from year to year due to changes in student composition, rather than real changes in 
student performance. However, there is no universal definition for what size is too small to produce 
reliable calculations, and states varied considerably in the minimum n sizes that they set, ranging from a 
low of 1 in North Dakota to a high of 50 in California, Texas, Virginia and West Virginia; most states 
used a minimum n size of 30 to 40 students. 
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Most African-American, Hispanic, and white students, and most students from 
low-income families, attended schools in which AYP was calculated for their 
respective subgroup because the minimum n of students needed to constitute a 
subgroup was met. 

In 41 states with available data, at least 83 percent or more of all white, African-American, and Hispanic 
students, as well as students from low-income families, attended schools in which AYP was calculated 
for these subgroups in 2005—06 (see Exhibit 26). However, only about half of Native American and 
Asian students attended schools in which AYP was calculated for their subgroups (46 percent and 
55 percent, respectively); these two groups are smaller in size and less geographically concentrated and 
thus were less likely to meet state minimum n sizes at the school level. Available data did not permit 
making similar estimates for the students with disabilities and LEP subgroups. 



Exhibit 26 

Percentage of Students in Each Subgroup in Schools Held Accountable for 
Their Subgroup, by Student Subgroup, 2005-06 


Student Subgroup 


Total number of 
students in this 
subgroup in grades 
used to calculate 
AYP (a) 


Number of students 
in this subgroup in 
schools held 
accountable for this 
subgroup (b) 


Percent of students 
in each subgroup in 
schools held 
accountable for 
their subgroup (b/a) 


African-American 


3,733,587 


3,084,523 


83% 


American Indian/Alaskan Native 


222,057 


102,318 


46% 


Asian/Pacific Islander 


1,053,416 


578,128 


55% 


Hispanic 


3,866,759 


3,305,620 


85% 


White 


12,480,628 


12,100,036 


97% 


Total across these five major 
racial/ethnic categories in 41 states 


21,356,447 


19,170,625 


90% 


Estimated total across these five major 
racial/ethnic categories for all 50 states, 
the District of Columbia, and Puerto 
Rico 


25,372,574 


22,730,412 


90% 


Low-income students for all 50 states, 
the District of Columbia, and Puerto 
Rico 


19,593,343 


17,513,800 


89% 


Exhibit reads: Eighty-three percent of African-American students attended schools for which AYP was 
calculated for the African-American subgroup. 

Note: The numbers of students in the racial or ethnic subgroups are based on 2005—06 CCD enrollment figures by 
race or ethnicity in those grades 3—8 and 10 that were used in AYP calculations in 2005—06 by each of the 41 states. 
The estimated total for all states is based on the assumption that the percent of students held accountable for each 
racial/ ethnic category was the same for the 1 1 states lacking data as for those 41 states for which data were available. 
The numbers of low-income students are based on number of students eligible for free or reduced-priced lunches 
across all grades in the 2005-06 CCD. CCD data did not permit making similar estimates for students with 
disabilities and LEP student subgroups. Only schools with valid ATT status assigned (i.e., made or did not make 
AYP) were included. 

Source: SS1-NCLB, National AYP and Identification Database (« = 41 states). 



Across all five racial/ ethnic subgroups, 90 percent of students were in schools for which AYP 
determinations were made for their subgroup in 2005—06, amounting to an estimated 22.7 million 
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students in grades that were used to calculate AYP (based on data for 50 states and the District of 
Columbia). The remaining 10 percent (2.6 million students) did not have school-level AYP 
determinations calculated for their racial/ ethnic subgroup. However, they would have been included in 
the school’s overall AYP calculation for the “all students” group, may have been included in other 
school-level calculations for other subgroups (e.g., students from low-income families), and may have 
been included in racial/ ethnic subgroup calculations for determining district-level AYP. 

Overall, schools were most likely to have AYP calculated for the white and low-income subgroups 
(71 percent and 65 percent, respectively). Thirty percent of all schools had AYP calculated for 
African-American students, Hispanic students, and students with disabilities. A smaller percentage of 
schools had AYP calculations made for LEP students (20 percent), Asian students (13 percent), or 
American Indian students (9 percent) (see Exhibit 27). 

Reasons Schools Did Not Make AYP 

Schools did not make AYP in 2005—06 for a 
wide variety of reasons. For example, of 
schools that did not make AYP in 2005—06, 

67 percent missed for a reading achievement 
target and 58 percent missed for a target in 
mathematics, while 42 percent did not make 
AYP in both subjects. (However, just 
15 percent missed for the school as a whole 
(the “all students” group) in both subjects.) 

Of schools that did not make AYP in 
2005—06, 17 percent of schools missed the 
95 percent test participation requirement 
and 22 percent missed a target for their 
state’s other academic indicator. 



Similarly, some schools did not make AYP 
due to the reading or mathematics 
proficiency of the “all students” group or 
due to the reading or mathematics 
proficiency of two or more student 
subgroups, whereas others did not make 
AYP for one subgroup or because they 
missed the 95 percent test participation 
requirement. Not making AYP due to the 
achievement of the “all students” group or 
due to the achievement of two or more 
student subgroups suggests that schools are being held accountable for widespread low performance. 

On the other hand, making AYP for the “all students” group and not making AYP for a single subgroup 
typically suggests a difference between the school’s overall performance and the performance of a very 
specific subgroup of its students. NCUB’s requirement to disaggregate achievement data by subgroup 
makes possible the identification of such differences. 



Exhibit 27 

Number and Percentage of Schools Required to 
Calculate AYP for Each Student Subgroup, 
2005-06 




Schools Required to Calculate 
AYP for Subgroup 


Student Subgroup 


Number of 
Schools 


Percentage of 
All Schools 


African-American 


25,807 


30% 


American Indian / 
Alaskan Native 


7,503 


9% 


Asian/Pacific Islander 


1 1 ,338 


13% 


Hispanic 


25,602 


30% 


White 


60,371 


71% 


Low-income students 


55,646 


65% 


Students with disabilities 


25,491 


30% 


LEP students 


17,126 


20% 


Exhibit reads: Thirty percent of schools had a sufficient 
number of African-American students to require 
calculation of AYP for this subgroup. 


Source: SSl-NCLB, National AYP and Identification Database 
(based on data reported by 50 states and the District of 
Columbia for 85,435 schools in these states). 
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Over half of the schools that did not make AYP in 2005-06 missed because the “all 
students” group or two or more subgroups of students did not meet achievement 
targets. 

Schools most commonly did not make AYP for the achievement of all students or multiple subgroups in 
2005—06; only in a minority of cases did schools miss just one AYP target. Based on data from 43 states, 
among schools that did not make AYP in 2005—06, 35 percent did not meet achievement targets for the 
“all students” group in reading and/or mathematics (see Exhibit 28). An additional 20 percent of these 
schools did not make AYP for the achievement of two or more subgroups although they made AYP for 
the “all students” group. One-quarter (24 percent) did not make AYP solely due to the achievement of a 
single subgroup. The remaining schools did not make AYP solely due to the “other academic indicator” 
(6 percent); solely because of their test participation rates (4 percent); or for other reasons, such as 
combinations of the achievement of a single subgroup, the other academic indicator, and test 
participation, or the alternate AYP determination for small schools and schools without tested grades 
(11 percent). 58 



Exhibit 28 

AYP Targets Missed by Schools That Did Not Make Adequate Yearly Progress, 2005-06 



Achievement 
of "All Students" 
Group 
35% 



Achievement 
of a 

Single Subgroup Only 

24% 




Students with 
Disabilities Only 


14% 


LEP Students 


4% 


Only 


Low-Income 
Students Only 


4% 


Single Racial/ 


3% 


Ethnic Group Only 



Tost 

P a rti ci pation 
Only 

Other 
Acadermc 
IndcatorOrty 

Exhibit reads: In 2005—06 testing, 35 percent of schools that did not make AYP missed targets for the 
achievement of the “all students” group in reading and/or mathematics. 



Notes: The sum of the subcategories of the “Single Subgroup Only” category does not equal 24 percent due to 
rounding. Schools included in the “Achievement of the ‘All Students’ Group” and the “Achievement of Two or 
More Subgroups” segments of the graph may have also not made AYP for test participation or the other academic 
indicator. However, schools included in the “Achievement of a Single Subgroup Only” segment are those that did 
not make AYP for that factor alone and did not miss any other AYP targets. “Other” includes schools that did not 
make AYP for combinations of the achievement of a single subgroup, test participation, and/ or the other academic 
indicator, or through a small school analysis. 



Source: SSl-NCLB, National AYP and Identification database (based on data reported by 43 states for 20,463 
schools that did not make AYP in these states). 



58 For distribution of schools by reasons they did not make AYP by states, see Appendix C, Exhibits C.2, C.3, and C.4. 
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About one quarter of the schools that did not make AYP met reading and 
mathematics proficiency targets for the school as a whole but missed for one 
subgroup. 

A key feature of the NCU3 accountability system is the disaggregation of achievement test data by 
subgroups in order to identify differences in proficiency between subgroups and the school as a whole. 
Twenty-four percent of schools that did not make AYP missed targets due to low levels of proficiency 
a single subgroup. More than one-half of these schools did not make AYP solely for the students with 
disabilities subgroup (this represents 14 percent of schools that did not make AYP). 

The pattern of targets missed by schools that did not make AYP has been remarkably stable over the 
past three years (see Exhibit 29). Looking at a consistent set of 26 states for which data were available 
across 2003—04, 2004—05 and 2005—06, the only change in the pattern is a small increase in the 
percentage of schools that did not make AYP due to the achievement of the “all students” group 
(increasing from 31 percent in 2003-04 to 41 percent in 2004-05 to 35 percent in 2005-06). 59 



59 For cross-sectional results for these three years, see Appendix C., Exhibit C.5. 



Exhibit 29 

AYP Targets Missed by Schools That Did Not Make Adequate Yearly Progress, 

2003-04 to 2005-06 
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Exhibit reads: In 2003—04 testing, 31 percent of schools that missed AYP missed targets for the 
achievement of the “all students” group in reading, mathematics, or both. 

Notes: Schools included in the “Achievement of ‘All Students’ Group” and the “Achievement of Two or More 
Subgroups” segments of the graph may have also not made AYP for test participation or the other academic indicator. 
However, schools included in the “Achievement of a Single Subgroup Only” segment are those that did not make AYP 
for that factor alone and did not meet any other AYP targets. “Other” includes schools that did not make AYP for 
combinations of the achievement of a single subgroup, test participation, or the other academic indicator, or through a 
small school analysis. Percentages may not add to 100 percent because of rounding. 

Source: SSl-NCLB, National AYP and Identification database (based on 26 states with sufficient data in 2003-04, 
2004-05, and 2005-06 and 13,497 schools that did not make AYP in 2003-04, 14,458 schools in 2004—05, and 
14,981 schools in 2005-06 in these states). 



The subgroups most likely to miss AYP targets were students with disabilities, LEP 
students, and African-American students. 

The rates at which specific subgroups did not make AYP varied dramatically. Among schools for which 
AYP was calculated for the subgroup of students with disabilities, 43 percent did not make AYP 
achievement targets for the students with disabilities subgroup. (These schools may have also not made 
AYP for other reasons, such as other subgroups, test participation, attendance or graduation rates.) 60 
Similarly, 30 percent and 25 percent of schools for which AYP was calculated for the LEP and 
African-American subgroups, respectively, did not make AYP for those subgroups (see Exhibit 30). 
Schools held accountable for subgroups of students from low-income families and Hispanic students 
were somewhat less likely to have not made AYP for those subgroups (20 percent and 18 percent, 



60 See Appendix C, Exhibit C.6 for percentage of schools that did not make AYP for subgroup achievement targets only, 
by student subgroup. 
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respectively). Schools held accountable for Asian (2 percent) and white (3 percent) and Native American 
(8 percent) subgroups were much less likely to have not made AYP for those subgroups. 



Exhibit 30 

Percentage of Schools Held Accountable for a Subgroup That Did Not 
Make AYP for That Subgroup, 2005-06 
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Exhibit reads: In 2005—06 testing, 20 percent of schools that had the minimum number of students 
from low-income families necessary for AYP to be calculated for this subgroup at the school did not 
make AYP for this subgroup. 

Note: See Exhibit 27 for the number of schools required to calculate AYP for each student subgroup. 

Source: SSI-NCLB, National AYP and Identification Database (based on data reported by 50 states and the 
District of Columbia for 85,440 schools in these states). 



Looking at individual subgroups, each subgroup was more likely to not make AYP when it was in a 
school with a higher poverty level or a higher concentration of minority students. 61 For example, the 
African-American subgroup did not make AYP in 2005—06 in 11 percent of low-poverty schools in 
which the subgroup was of sufficient size to be calculated, but it did not make AYP for 34 percent of 
high-poverty schools in which the subgroup was of sufficient size to be calculated (see Exhibit 31). 
Similarly, the students with disabilities subgroup did not make AYP in 32 percent of low-poverty 
schools, compared with 61 percent of high-poverty schools. 



61 Results for poverty level are shown as an example. Results by minority level are not shown but are similar. 
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Exhibit 31 

Percentage of Schools That Did Not Make AYP for Individual Student Subgroups, 

by School Poverty Rate, 2005-06 
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African-American 
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22% 
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2% 


8% 


17% 
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Hispanic 


8% 
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Native American 
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Low-income students 
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31% 


Students with disabilities 


32% 


45% 


50% 


61% 


LEP students 


13% 


26% 


38% 


49% 


Exhibit reads: In 2005—06, among low-poverty schools for which AYP was calculated for African- 


American students, 1 1 percent did not make AYP for that subgroup. 




Source: SSl-NCLB, National AYP and Identification Database (based on data reported by 47 states for 81,836 
schools in these states). 



Not making AYP due to the other academic indicator was more prevalent at the high 
school level. 

States commonly selected attendance as the other academic indicator for elementary and middle schools. 
High schools were required to use graduation rates. In December 2008, after these analyses were 
conducted, the U.S. Department of Education issued new non-regulatory guidance on high school 
graduation rates. 62 Of the schools that did not make AYP in 2005—06, 22 percent missed the other 
academic indicator. The rates varied by school level: 14 percent of elementary schools, 13 percent of 
middle schools, and 40 percent of high schools (see Exhibit 32). However, only 6 percent of schools 
that did not make AYP missed solely due to the other academic indicator. Thirteen percent of the high 
schools that did not make AYP missed solely due to the graduation rate. 



62 High School Graduation Rate Non-Regulatoiy Guidance, http:/ / www.ed.gov/ policy/ elsec/ guid/hsgrguidance.pdf (accessed 
June 2009). 
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Exhibit 32 

Percentage of Schools That Did Not Make AYP That Missed Due to the 
Other Academic Indicator, by School Grade Level, 2005-06 




Schools Did Not Make AYP for: 


Grade Level 


Other Academic Indicator 


Other Academic Indicator Only 


Total (n = 16,713) 


22% 


6% 


Elementary (n = 9,003) 


14% 


3% 


Middle (n = 6,047) 


13% 


1% 


High (0 = 5,376) 


40% 


13% 


Other (o = 1,266) 


50% 


18% 


Exhibit reads: Of the schools that did not make AYP, 22 percent of schools did not make AYP for the 
other academic indicator. 


Note: Grade levels were defined using Common Core of Data (CCD) codes. The “other” category includes any 


grade configuration not falling in the CCD elementary, middle, or high school codes, including ungraded schools. 


Source: SSl-NCLB, National AYP and Identification Database (based on data 
of Columbia for 21,722 schools that did not make AYP in these states). 


eported by 47 states and the District 



Across states, the percentage of high schools that did not make AYP because they missed graduation 
rate targets ranged from 0 to 94 percent. States calculate graduation rates in different ways and set their 
target graduation rates at different levels: targets ranged from 50 to 97 percent in 2003—04 and will range 
from 65 to 100 percent in 2013—14 (see Chapter II, Exhibit 14, for examples of four state trajectories). 
For elementary and middle schools, the percentage that missed due to their other academic indicators 
ranged from 0 to 81 percent across states. In 31 states out of the 48 reporting, less than 10 percent of 
the elementary and middle schools that did not make AYP missed because of the other academic 
indicator. 

Stability of the reasons schools did not make AYP 

Four-fifths of schools had the same AYP designation from one year to the next. 

Eighty-one percent of schools had the same overall AYP designation in 2003—04 and 2004—05. The 
majority of schools, 66 percent or 54,012, made AYP in both years, but 15 percent or 12,491 did not 
make AYP in both years (and were potentially subject to identification for improvement if their reasons 
for not making AYP were within the same subject in both years). Schools whose AYP designations 
changed were evenly split between those whose designation “worsened” (i.e., moved from making AYP 
in 2003—04 to not making AYP in 2004—05) and those whose designation “improved”; 9 percent of 
schools’ designations worsened and 1 0 percent of schools’ designations improved. The results were 
similar for 2004—05 to 2005—06 (see Exhibit 33). 
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Exhibit 33 

Percent and Number of Schools With Consistent AYP Designations in 
2003-04, 2004-05 and 2005-06 









Did Not Make AYP 


Made AYP 




AYP Status 


AYP 2004-05 


AYP 2003-04 


Did not make AYP 


15 % 

( 12 , 491 ) 


9 % 

( 7 , 457 ) 


Made AYP 


10 % 

( 8 , 143 ) 


66 % 

( 54 , 012 ) 




AYP 2005-06 


AYP 2004-05 


Did not make AYP 


16 % 

( 12 , 846 ) 


9 % 

( 7 , 359 ) 


Made AYP 


10 % 

( 8 , 394 ) 


65 % 

( 52 , 583 ) 



Exhibit reads: Fifteen percent or 12,491 schools did not make AYP in both 2003—04 and 2004—05. 



Note: Numbers in parenthesis indicate number of schools. 

Source: SSI-NCLB, National AYP and Identification Database, 2003-04 and 2004—05 (based on 81,203 schools in 
50 states and the District of Columbia for 2003-04 to 2004—05 and 81,212 schools in 50 states and the District of 
Columbia for 2004—05 and 2005-06). 



More than half of the schools that did not make AYP in 2003-04 missed fewer AYP 
targets in 2004-05. 

Fifty-six percent of the schools that did not make AYP in 2003—04 missed fewer targets in 2004—05. 
Fourteen percent missed the same number of targets and 30 percent missed more targets in 2004—05 
(see Exhibit 34). All schools that missed the same or fewer targets in 2004—05 continued to not make 
AYP overall. In addition, most of the schools that missed fewer targets in 2004—05 also continued to 
not make AYP overall because they did not make all targets. Typically, most attention has been paid to 
schools’ overall AYP designations, and the extent to which schools have reduced the number of targets 
they missed has been largely ignored other than in some states’ AYP reporting. However, reductions in 
the number of targets schools missed may represent substantial improvement in specific subjects for 
specific groups. Schools that missed more AYP targets in 2003—04 were more likely to miss fewer 
targets in the following year. Results were similar for 2004—05 to 2005—06. 

A key question about the stability of AYP designations is whether schools that did not make AYP for 
particular reasons in 2003—04 continued to not make AYP in 2004—05 and 2005—06 for those same 
reasons. In this analysis, we followed the schools that did not make AYP in 2003—04 for particular 
reasons for the next two years. We began by looking at the four general sets of reasons schools do not 
make AYP: reading proficiency, mathematics proficiency, participation rate, and the other academic 
indicator, rather than the specific subgroup targets that were missed. That is, if a school did not make 
AYP because it missed a reading proficiency target for any group or subgroup in 2003—04, that school 
was examined to determine if it continued to miss any reading proficiency targets for any group or 
subgroup in 2004—05 and 2005—06. Because a school may have several subgroup reading targets as well 
as an “all students” reading target, some of the schools classified as not making AYP in multiple years 
may have missed for the reading proficiency of one subgroup in 2003—04 and for the reading proficiency 
of a different subgroup in 2004-05 or 2005-06. 
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Exhibit 34 

Percent of Schools That Missed Fewer, the Same, and More AYP Targets Than 
They Did in the Prior Year, by Number of Targets Missed in the Prior Year 






Percentage of Schools in 2004-05 That 


AYP Target(s) Missed 


Number of Schools 
that Missed AYP in 
2003-04 


Missed Fewer 
Targets 


Missed Same 
Number of Targets 


Missed More 
Targets 


1 


2,715 


45% 


15% 


40% 


2-3 


3,835 


51% 


15% 


34% 


4-7 


3,091 


61% 


12% 


26% 


8-11 


1,175 


71% 


11% 


18% 


12-15 


401 


81% 


10% 


10% 


16-19 


155 


90% 


5% 


5% 


20-27 


48 


87% 


2% 


10% 


28-37 


0 


na 


na 


na 


Total 

(any number of targets) 


1 1 ,420 


56% 


14% 


30% 






Percentage of Schools in 2005-06 That 


AYP Target(s) Missed 


Number of Schools 
that Missed AYP in 
2004-05 


Missed Fewer 
Targets 


Missed Same 
Number of Targets 


Missed More 
Targets 


1 


2,987 


53% 


21% 


26% 


2-3 


4,008 


57% 


18% 


25% 


4-7 


3,954 


62% 


16% 


22% 


8-11 


1,285 


59% 


22% 


19% 


12-15 


301 


67% 


16% 


16% 


16-19 


72 


69% 


17% 


14% 


20-27 


23 


74% 


9% 


17% 


28-37 


7 


na 


na 


na 


Total 

(any number of targets) 


12,673 


58% 


19% 


23% 


Exhibit reads: Of schools that missed one target in 2003—04, 45 percent missed zero targets in 
2004—05, while 15 percent missed one target again in 2004—05, and 40 percent missed more than one 
target in 2004—05. 

Notes: Percentages may not add to 100 percent because of rounding, “na” means not applicable. 

Source: SSI-NCLB, National AYP and Identification Database (based on 11,420 schools in 26 states in first 
panel and 12,673 schools in 26 states in second panel). 
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Schools that did not make AYP for test participation or the other academic indicator 
were more likely to improve their AYP results for those indicators over time than 
schools that did not make AYP for reading or mathematics proficiency. 



Schools that did not make AYP targets for reading or mathematics proficiency in 2003—04 were more 
likely to not make AYP targets again in 2004—05 or 2005—06 for those same reasons than schools that 
did not make AYP targets for test participation or the other academic indicator. In reading, 57 percent 
of schools that missed a reading proficiency target in 2003—04 missed a reading proficiency target again 
in 2004—05. In mathematics, 63 percent of the schools that missed for mathematics in 2003—04 missed 
again for mathematics in 2004—05 (see Exhibit 35). In contrast, 25 percent of schools that did not make 
AYP because they did not meet the required 95 percent test participation rate did not meet the required 
rate again in 2004—05. 



Exhibit 35 

Number and Percentage of Schools That Did Not Make AYP, by Type of AYP Targets 
That They Missed, 2003-04, 2004-05 and 2005-06 


AYP Targets Missed 


Number of 
Schools that 
Missed in 
2003-04 


Percentage of 
Schools That 
Missed Again in 
2004-05 


Percentage of 
Schools That 
Missed Again in 
2005-06 


Any reading proficiency target 


9,464 


57% 


42% 


Any mathematics proficiency target 


8,421 


63% 


45% 


Any participation target 


3,891 


25% 


15% 


Any other academic indicator target 


2,109 


33% 


18% 


Exhibit reads: Fifty-seven percent of schools that missed a reading proficiency target in 2003—04 
missed a reading proficiency target again in 2004—05. Forty-two percent of schools that missed a reading 
proficiency target in 2003—04 missed a reading proficiency target again in 2005—06. 

Source: SSI-NCLB, National AYP and Identification Database (based on 1 1,420 schools in 26 states with all 
necessary data in all three years). 



There were similar results regarding the state-defined other academic indicator; 33 percent of schools 
that missed the other academic indicator in 2003—04 missed it again in 2005—06. The percentage of 
schools that did not make the other academic indicator again was lower than the percentage that did not 
make their proficiency targets again. However, analyses by grade level revealed that elementary and 
middle schools were less likely than high schools to miss the other academic indicator targets again 
because they used different other academic indicators. Fourteen percent of elementary schools and 
22 percent of middle schools that did not make their other academic indicator (state-defined but often 
attendance rate) in 2003—04 missed again in 2004—05. In contrast, 37 percent of high schools that did 
not make their other academic indicator (graduation rate) in 2003—04 missed again in the following year 
(see Appendix C, Exhibit C.7). The same pattern of results was found when schools were followed for 
another year into 2005—06. These results indicate that it may be easier for schools to remedy problems 
with test participation or other academic indicators than it is to remedy problems with reading or 
mathematics proficiency. 
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Schools that did not make AYP for the Asian and white subgroups were more likely 
to improve their AYP results for those subgroups over time than schools that did 
not make AYP for other subgroups. 



Thirty-one percent and 37 percent of schools that did not make a reading proficiency target in 2003—04 
for the Asian and white subgroups, respectively, missed the same target again in 2004—05 (see 
Exhibit 36). By contrast, approximately half of the schools that missed a reading proficiency target in 

2003- 04 for the “all students” (57 percent), low-income students (56 percent), Hispanic (56 percent), 
African-American (54 percent), andLEP student (53 percent) subgroups missed the same target in 

2004— 05. This higher likelihood of change in status in the Asian and white subgroups may be due in part 
to the small number of schools that did not make AYP for each of these groups. It is important to note 
that in the years analyzed not all states were using assessment data from all grades 3—8 and one 
secondary grade for AYP determinations; therefore, some change in status may also be due to cohort 
changes or changes in policies regarding subgroups. 63 A similar pattern of results was found in 
mathematics and when schools were followed for another year into 2005—06. 



Exhibit 36 

Number and Percentage of Schools That Did Not Make AYP Consistently for 
Each Subgroup, 2003-04, 2004-05, and 2005-06 




Reading Proficiency 


Mathematics Proficiency 


Student Group 


Number of 
Schools 
that Missed 
in 2003-04 


Percentage 
of Schools 
That Missed 
Again in 
2004-05 


Percentage 
of Schools 
That Missed 
Again in 
2005-06 


Number of 
Schools that 
Missed in 
2003-04 


Percentage 
of Schools 
That Missed 
Again in 
2004-05 


Percentage 
of Schools 
That Missed 
Again in 
2005-06 


“All students” group 


2,628 


57% 


40% 


2,728 


61% 


41% 


American Indian 


96 


45% 


31% 


79 


37% 


23% 


Asian 


165 


31% 


18% 


56 


36% 


25% 


Hispanic 


1,658 


56% 


44% 


1,410 


55% 


38% 


African American 


2,108 


54% 


33% 


2,794 


59% 


38% 


White 


205 


37% 


26% 


268 


37% 


22% 


Low-income Students 


2,850 


56% 


41% 


1,845 


53% 


35% 


Students with Disabilities 


5,400 


46% 


32% 


4,921 


52% 


36% 


LEP Students 


3,259 


53% 


37% 


3,141 


58% 


37% 


Exhibit reads: In 2003—04, 2,628 schools missed the “all students” reading proficiency target; of those 
schools, 57 percent missed the same target again in 2004—05 and 40 percent missed the same target again 
in 2005-06. 


Source: SSl-NCLB, National AYP and Identification Database (based on 11,420 schools in 26 states). 





63 When schools that did not make AYP in 2003—04 made AYP in 2004—05, it was not always because their students’ 
proficiency improved; approximately a fifth of the schools did not need to calculate AYP for the subgroup in 2004—05 
and reported the subgroup as not applicable. The students with disabilities subgroup was the most likely subgroup to 
change status from not making AYP in 2003—04 to not applicable in 2004—05. Thirty-seven percent of the schools that 
missed for this subgroup in 2003—04 did not calculate AYP for the group in 2004—05. Again, small numbers of students 
and cohort changes may contribute to this instability in these schools’ need to calculate AYP for this subgroup, but 
changes in the minimum n size or changes in the rules for including students with disabilities in testing may also be 
contributing factors. 
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AYP Appeals 



Approximately one in ten schools that did not make AYP in 2005-06 appealed the 
determination to their state. Almost 40 percent of these appeals were successful. 

The rates for appeal applications and approval varied sharply across states. 

NCLB includes provisions that allow local education agencies (LEAs) the opportunity to appeal AYP 
determinations on behalf of their schools. LEAs appealed in 38 of the 42 states that reported appeals 
data. AYP determinations were appealed for approximately 2,306 schools (11 percent of all schools that 
did not make AYP in 2005— 06). 64 The number of appeals ranged from two in Rhode Island to 525 in 
Arizona. The states with the highest numbers of AYP appeals (1 00 or more) were Arkansas, Arizona, 
California, Maryland, Tennessee and Texas. Of the appeals following 2005—06 testing, 38 percent were 
approved. The rate at which states approved appeals ranged from 0 percent in Louisiana to 100 percent 
in Montana and New Mexico. Among the states with the highest numbers of appeals listed above, 
approval rates ranged from 23 percent in Arkansas to 62 percent in Maryland. Similarly, districts could 
appeal their own district AYP determinations. Of the approximately 356 appeals by districts, 43 percent 
were approved. 

Most successful appeals involved either errors in data or the misclassification of students to subgroups. 
However, states noted a long list of reasons for successful appeals, including graduation rate 
recalculations, safe harbor recalculations, small schools issues, test administration errors, and 
extraordinary circumstances beyond school control affecting testing. A large majority of states (32 of 42 
responding) indicated that they did not face any challenges tracking AYP appeals. However, four states 
emphasized that tracking appeals was a time- and resource-consuming process, three other states noted a 
large variation in the quality of district reporting of data for appeals determinations, and three more 
states reported that it was a challenge to accurately track all the necessary data. 

Discussion 

The differences in the ways in which states have implemented the accountability provisions of NCLB 
(described in Chapter II), combined with differences in student demographics and student performance, 
have led to marked state-to- state differences in the proportion of schools and districts making AYP. In 
some states, nearly all schools and districts made AYP, while in a few states, large majorities of schools 
and districts did not. These differences also help to explain why some states’ proportions of schools 
making AYP rose while other states’ proportions dropped. 

Schools did not make AYP for a range of different reasons and therefore face quite different school 
improvement tasks. Schools most commonly did not make AYP due to the low achievement of students 
in the school as a whole or across multiple subgroups, rather than solely due to factors such as test 
participation, attendance, or graduation rates. These schools may require an intervention that involves 
multiple components and addresses the full student population. However, about one-quarter of schools 
did not make AYP due to a single subgroup. These schools may require an intervention that is targeted 
to the school’s particular areas of weakness. Many reauthorization proposals of the No Child Left Behind 
Act of 2001 recognize this fact and seek to differentiate accountability through a more thorough 
examination of the particular reasons each school did not make AYP and the use of that information to 
better target supports and sanctions related to identification for improvement (Sparks, 2007). 



64 This analysis includes 40 states, the District of Columbia, and Puerto Rico. See Appendix C, Exhibit C.8. 



Chapter III 



70 



While four-fifths of schools had the same overall AYP designation from one year to the next, the 
specific AYP targets that schools missed shifted over the years. Most schools missed fewer targets over 
the years and most schools that missed for insufficient participation or the other academic indicator 
moved from missing to making those targets. Challenges remained, however, with schools that did not 
make targets for reading or mathematics proficiency and those that did not make targets for historically 
disadvantaged subgroups being less likely to improve their AYP results than were schools that missed 
other targets. 

States continued to make substantial progress toward the goal of counting the achievement of every 
child. States implemented testing in more grades and continued to disaggregate data by student 
subgroup so that the performance of children from minority and low-income families could not be 
obscured by the overall performance of the school. As a result, nearly half of the schools that did not 
make AYP did not make AYP targets for one or more subgroups, though they made AYP for the school 
as a whole. To fulfill the promise of NCUi, districts and schools must now respond to the needs of 
these low-performing subgroups; this may constitute one of the most challenging tasks confronting 
administrators and educators. 
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IV. IDENTIFYING SCHOOLS AND DISTRICTS 
FOR IMPROVEMENT 

A key component of NCLJi accountability is the identification of schools and districts for improvement. 
Under NCLB, states are required to identify for improvement any Title I school that does not meet 
state-defined AYP targets in the same subject or indicator for two consecutive years. In addition, 

34 states have opted to identify non— Title I schools through a similar process. Identification is used 
both to target assistance to schools and districts and for other interventions. Each additional year in 
which a school does not make AYP triggers increasingly more extensive interventions, as described in 
Chapter II. An identified school exits improvement status if it makes AYP for two consecutive years. 



Key Findings 

• After a large increase from 2003—04 to 2004—05, the percentage of Title I schools 
identified for improvement increased more gradually from 2005—06 to 2006—07. 

Fifteen percent of the nation’s schools (including Title I and non— Title I schools) were identified 
for improvement for 2006—07. Title I schools accounted for 83 percent of all identified schools, 
and the 10,781 identified Title I schools represented 20 percent of all Title 1 schools. 

• Almost half (46 percent) of Title I schools that had been identified for improvement for 
2004—05 were in the more advanced stages of identification status — corrective action and 
restructuring — in 2006—07. 

• There has been a decline over time in the proportion of identified Title I schools annually 
exiting from improvement status. The percentage of Title I schools exiting from 
improvement status declined from 23 percent in 2004—05 to 17 percent in 2005—06 to 12 percent 
in 2006-07. 

• In 2006—07, the majority of identified Title I schools were concentrated in just over 1 
percent of the nation’s Title I districts. Over half (53 percent) of all Title I schools identified 
for improvement were located in the 177 districts that each had 10 or more identified schools in 
2006—07. Four-fifths of districts contained no identified schools and most of the rest contained 
only one or two identified schools. 

• High-poverty, high-minority, and middle schools, and large schools in urban areas, were 
more likely than other Title I schools to be identified for improvement for 2006—07. 

• Title I schools in the more advanced stages of improvement status during 2006—07 were 
most likely to have missed AYP for the achievement of “all students” or for two or more 
subgroups than other Title I schools. 

• Although 13 percent of Title I districts (1,728) were identified for improvement for 
2006—07, these districts enrolled 40 percent of the nation’s students, or about 18 million 
students. The number of districts identified for improvement for 2006—07 was similar to the 
previous year, but the number of districts identified for corrective action increased five-fold. 
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Schools and Districts Identified for Improvement 



A total of 13,103 schools (15 percent of all schools, both Title I and non— Title I) were identified for 
improvement for 2006—07 (based on test scores from 2005—06 and earlier years). 65 Title I schools 
accounted for more than four- fifths of all identified schools. The remainder of this section focuses 
primarily on Title I schools. 

After a large increase between 2003-04 and 2004-05, the percentage of Title I schools 
identified for improvement increased more gradually between 2005-06 and 2006-07. 

The percentage of Title I schools identified for improvement increased from 18 percent in 2005—06 to 
20 percent in 2006—07. This increase was gradual compared to the large jump from 12 percent to 
18 percent between 2003—04 and 2004—05. The number of Title I schools identified for improvement 
for 2006—07 (10,781) was about 1,000 greater than the number of identified schools for 2005—06 
(see Exhibit 37). Overall, 9.0 million students attended identified schools in 2006—07, up from 
7.3 million in 2004—05. 



65 The SSl-NCLB National AYP and Identification Database contains 89,828 schools (Tide I and non-Title I) with valid 
improvement status located in 50 states, the District of Columbia, and Puerto Rico (see Appendix A for more 
information about the National AYP and Identification Database). 
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Exhibit 37 

Number and Percentage of Title I Schools Identified for Improvement 

1996-97 to 2006-07 





Exhibit reads: In 2006—07, 10,781 Title I schools were identified for improvement based on test scores 
from 2005—06 and earlier years; identified schools represented 20 percent of all Tide I schools in 2006—07. 

Notes: The first year that schools were identified for improvement based in part on NCLB AYP definitions was 
2003-04, based on assessments administered in 2002-03. However, schools are identified when they do not make 
AYP for two consecutive years, and 2004—05 was the first year that includes schools identified because they did not 
make AYP targets for two consecutive years. Data for 2002-03 are not available due to a change in reporting 
requirements that was implemented beginning with the 2002—03 Consolidated State Performance Report. 

Source: Consolidated State Performance Reports (« = 50 states, the District of Columbia, and Puerto Rico). 
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In 2006-07, 46 percent of identified Title I schools were in either corrective action or 
restructuring. 

Forty-six percent of all identified Tide I schools in 2006—07 were in either corrective action or 
restructuring, up from 33 percent in 2005—06 and 23 percent in 2004—05. The number of Tide I schools 
in corrective action more than doubled, from 1,223 in 2005—06 to 2,663 in 2006—07 (25 percent of 
identified Title I schools), while the number in restructuring status 66 rose from 1,683 to 2,270 (21 percent 
of identified Title I schools) (see Exhibit 38). 



Exhibit 38 

Number of Title I Schools Identified for Improvement, by Identification Status 

2004-05 to 2006-07 



8000 




Year 1 or Year 2 Corrective Action Restructuring 



Exhibit reads: The number of Title I schools in the first or second year of school improvement 
status declined from 7,157 in 2004—05 to 5,848 in 2006—07. 

Sources: Consolidated State Performance Reports and SSl-NCLB, National AYP and Identification Data Base 
(» = 50 states, the District of Columbia, and Puerto Rico). 



Changes in improvement status 

To exit improvement status, schools are required to make AYP for two consecutive years. It can be 
challenging to achieve this level of improvement because the annual measurable objectives upon which 
AYP is based rise gradually over the years, essentially “raising the bar” over time. 

There has been a decline over time in the proportion of identified Title I schools 
exiting improvement status. 

The percentage of Title I schools exiting from improvement status declined from 23 percent in 2004—05 
to 17 percent in 2005—06 to 12 percent in 2006—07. As a result of this decline, 12 percent 
(1,169 schools) of the Title I schools that were identified for improvement for 2005—06 were no longer 
identified for 2006—07 because they made AYP for two consecutive years or for other reasons 



66 The data do not allow us to distinguish schools in restructuring that are planning for restmcturing from those that are 
implementing restructuring. 
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(see Exhibit 39). Of the schools that were in corrective action and restructuring for 2005—06, 6 percent 
and 4 percent, respectively, exited improvement status for 2006—07. 



Exhibit 39 

Number and Percentage of Title 1 Schools Identified for Improvement for 2005-06 
That Exited Improvement Status in 2006-07 




Niimher of Schools 


Schools No Longer Identified for 2006-07 


School Improvement Status for 2005-06 


Identified in 2005-06 


Number 


Percent 


Total 


9,676 


1,169 


12% 


Year 1 


3,848 


793 


21% 


Year 2 


2,893 


242 


8% 


Corrective action 


1,189 


71 


6% 


Restructuring 


1,746 


63 


4% 


Exhibit reads: Of the 9,676 schools that were identified for school improvement status for 2005—06, 1,169 


schools, or 12 percent, were no longer identified for 2006—07. 






Source: SSl-NCLB, National AYP and Identification Database (» — 9,676 Title I schools identified in 2004-05 with data for 


both years). 









To examine changes in identification status over a longer period of time, we followed the cohort of 
Title I schools that were identified in 2004—05 to see what their improvement status was in 2006—07. 
Most Title I schools that were identified for improvement for 2004—05 remained in improvement status 
two years later, and most of these had progressed to more advanced stages of improvement status. 

Nearly three-fourths (72 percent) of the Title I schools identified for 2004—05 continued to be identified 
schools in 2006—07, while 28 percent had exited school improvement status (see Exhibit 40). About half 
of the 2004—05 cohort of identified Title I schools were in corrective action (25 percent) or restructuring 
status (22 percent) by 2006—07; about one quarter of the 2004—05 cohort of identified schools were in 
Year 1 or Year 2 of school improvement status (8 percent and 17 percent, respectively) in 2006—07. 
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Exhibit 40 

Percentage of Title 1 Schools Identified for Improvement for 2004-05 That Were in 
Various Stages of School Improvement Status for 2006-07 


School 
Improvement 
Status for 
2004-05 


n 


School Improvement Status in 2006-07 


No Longer 
Identified for 
Improvement 


Year 1 of 
Improvement 
Status 


Year 2 of 
Improvement 
Status 


Corrective 

Action 


Restructuring 
(Year 1) 


Restructuring 
(Year 2) 


Total 


9,767 


28% 


8% 


17% 


25% 


10% 


12% 


Year 1 


5,895 


29% 


12% 


25% 


34% 


1%* 


1%* 


Year 2 


1,454 


23% 


2%* 


10% 


23% 


42% 


0% 


Corrective 

Action 


911 


20% 


2%* 


2%* 


11% 


23% 


43% 


Restructuring 


1,069 


19% 


1%* 


1%* 


0% 


7% 


71% 



Exhibit reads: Of the Title I schools that were identified for improvement for 2004—05, 28 percent were no 
longer identified for improvement two years later in 2006—07. 

* indicates that according to standard identification progressions, no schools should have appeared in this cell. The small 
numbers of schools that do appear likely were incorrectly classified in 2004—05, or have experienced a nonstandard 
reclassification by their state, such as an appeal or redesignation based on transfer of student population. 

Sources: Consolidated State Performance Reports and SSl-NCLB, National AYP and Identification Database (« = 50 states, 
the District of Columbia, and Puerto Rico). 



Two-thirds (66 percent) of the Title I schools in corrective action in 2004—05 had moved into 
restructuring status by 2006—07. Over three-fourths (78 percent) of the Title I schools in restructuring 
status in 2004-05 were still in restructuring status in 2006-07. Nearly all (93 percent) of the Title I 
schools that were not identified for improvement in 2004—05 continued to be non-identified schools in 



2006-07. 
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Exhibit 41 

Number and Percentage of Schools Identified for Improvement, by State, 2006-07 



All Schools 



Title I Schools 



States 


Number 


Percent 


Number 


Percent 


Year 1 


Year 2 


Corrective 

Action 


Restructuring 


Year 1 


Year 2 


Total 


13,103 


15% 


10,781 


20% 


3,527 


2,321 


2,663 


999 


1,271 


Alabama 


459 


34% 


289 


33% 


209 


54 


3 


5 


18 


Alaska 


229 


46% 


113 


41% 


12 


24 


35 


30 


12 


Arizona 


161 


9% 


161 


14% 


75 


24 


36 


12 


14 


Arkansas 


209 


18% 


209 


25% 


69 


63 


54 


19 


4 


California 


2,240 


23% 


2,240 


37% 


719 


339 


482 


343 


357 


Colorado 


112 


7% 


112 


17% 


36 


25 


21 


16 


14 


Connecticut 


162 


17% 


110 


23% 


23 


17 


63 


1 


6 


Delaware 


34 


18% 


7 


7% 


2 


1 


3 


0 


1 


District of Columbia 


103 


53% 


103 


53% 


17 


53 


33 


0 


0 


Florida 


1,004 


31% 


1,004 


72% 


128 


302 


544 


30 


0 


Georgia 


380 


19% 


175 


15% 


51 


34 


23 


19 


48 


Hawaii 


174 


61% 


143 


71% 


38 


14 


38 


3 


50 


Idaho 


282 


45% 


98 


26% 


77 


9 


12 


0 


0 


Illinois 


581 


16% 


575 


24% 


82 


85 


93 


177 


138 


Indiana 


157 


8% 


157 


20% 


99 


25 


18 


6 


9 


Iowa 


18 


1% 


11 


2% 


4 


3 


4 


0 


0 


Kansas 


25 


2% 


25 


4% 


12 


8 


3 


2 


0 


Kentucky 


158 


13% 


158 


19% 


69 


27 


56 


1 


5 


Louisiana 


87 


7% 


72 


8% 


32 


33 


3 


4 


0 


Maine 


166 


32% 


20 


5% 


13 


3 


4 


0 


0 


Maryland 


181 


13% 


96 


25% 


20 


13 


15 


2 


46 


Massachusetts 


613 


35% 


455 


45% 


203 


73 


129 


24 


26 


Michigan 


403 


14% 


154 


8% 


21 


34 


46 


16 


37 


Minnesota 


63 


5% 


63 


7% 


23 


27 


10 


3 


0 


Mississippi 


57 


7% 


57 


9% 


23 


21 


12 


0 


1 


Missouri 


105 


5% 


105 


10% 


24 


64 


17 


0 


0 


Montana 


52 


11% 


52 


8% 


5 


11 


4 


1 


31 


Nebraska 


1 


<1% 


1 


<1% 


0 


0 


0 


1 


0 


Nevada 


70 


12% 


70 


52% 


25 


18 


18 


9 


0 


New Hampshire 


88 


19% 


34 


14% 


17 


15 


2 


0 


0 


New Jersey 


424 


19% 


424 


34% 


147 


112 


100 


16 


49 


New Mexico 


346 


43% 


262 


45% 


106 


62 


29 


17 


48 


New York 


513 


12% 


513 


17% 


110 


93 


67 


77 


166 


North Carolina 


299 


13% 


299 


26% 


163 


65 


59 


10 


2 


North Dakota 


19 


5% 


19 


6% 


0 


0 


3 


2 


14 


Ohio 


704 


18% 


472 


22% 


252 


92 


76 


19 


33 


Oklahoma 


37 


2% 


37 


3% 


10 


12 


10 


3 


2 


Oregon 


44 


3% 


44 


7% 


20 


14 


9 


0 


1 


Pennsylvania 


455 


15% 


176 


10% 


45 


24 


29 


15 


63 


Puerto Rico 


837 


53% 


799 


76% 


184 


207 


316 


62 


30 


Rhode Island 


61 


20% 


24 


17% 


1 


10 


9 


2 


2 


South Carolina 


187 


17% 


187 


37% 


53 


28 


69 


27 


10 


South Dakota 


45 


6% 


45 


13% 


10 


14 


7 


12 


2 


Tennessee 


171 


11% 


70 


8% 


17 


23 


10 


1 


19 


Texas 


291 


4% 


291 


5% 


186 


70 


33 


2 


0 


Utah 


10 


1% 


10 


4% 


5 


4 


0 


0 


1 


Vermont 


23 


7% 


15 


7% 


1 


12 


2 


0 


0 


Virginia 


62 


4% 


62 


8% 


17 


29 


12 


2 


2 


Washington 


100 


5% 


100 


11% 


47 


15 


26 


4 


8 


West Virginia 


23 


3% 


23 


6% 


7 


9 


6 


0 


1 


Wisconsin 


50 


2% 


33 


3% 


15 


6 


7 


4 


1 


Wyoming 


28 


8% 


7 


4% 


3 


1 


3 


0 


0 



Title I Schools By Improvement Status 



Exhibit reads: For 2006-07, 13,103 schools were identified for improvement (both Tide I and 
non-Tide 1, representing 15 percent of the nation’s schools.) 

Sources: Consolidated State Performance Reports and SSl-NCLB, National AYP and Identification Database 
(« = 50 states, District of Columbia, and Puerto Rico). 
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State-to-state differences in identification rates 

States continue to vary greatly in the percentage of Title I schools identified for 
improvement. 

Rates of identification of Title I schools ranged from less than 1 percent in Nebraska to more than 
70 percent in Florida, Hawaii, and Puerto Rico in 2006-07 (see Exhibit 41). Nine states identified 5 
percent or fewer of their Title I schools, while 12 states identified more than one-third of their Title I 
schools. Similarly, the numbers of Tide I schools in corrective action or restructuring status varied by 
state, from fewer than five in several states to more than 200 in a few states. As with AYP, it is 
important to consider the variability in the level of each state’s standards, assessments, and actual student 
achievement when reviewing states’ proportions of schools identified for improvement. 

Non-Title I identified schools represented 18 percent of all identified schools nationwide, but they 
accounted for more than half of all identified schools in 11 states. Twenty-eight states reported that they 
identified non— Title I schools for improvement for 2006—07 (reporting a total of 2,322 non— Title I 
identified schools). Fewer states had assigned non— Title I schools to corrective action status (18 states) 
or restructuring status (16 states). Overall, states had placed about 550 non— Tide I schools in corrective 
action or restructuring. Few states required the NCUi consequences of public school choice and 
supplemental educational services for identified non— Title I schools (three states each). 

In most states, a similar percentage of their Title I schools were identified for improvement annually 
between 2004—05 and 2006—07, but the proportion of identified schools changed substantially in some 
states. In eight states, at least 10 percent more of their Title I schools were identified for 2006—07 than 
for 2004—05; in Georgia, 10 percent fewer were identified (see Exhibit 41 compared to Appendix C, 
Exhibits C.9 and C.10). The number of states that identified substantial proportions of their Title I 
schools for improvement grew from 2004—05 to 2006—07. Eleven states identified 25 percent or more 
of their Title I schools for 2004—05, 14 did so for 2005—06, and 16 states did so for 2006—07. 
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Clustering of identified schools within districts 



Fourth- fifths of Title I districts 
continued to have no Title I schools that 
were identified for improvement. In 
2006-07, 19 percent of Title I districts 
(2,618 of 13,997) had at least one 
identified Title I school, nearly the same 
proportion of districts as in the previous 
two years (see Exhibit 42). A previous 
longitudinal study found that 21 percent 
of Title I districts had at least one 
identified school in 2001—02; in 
2002—03, this proportion was 
16 percent, and in 2003—04, this 
proportion decreased further to 
14 percent (Padilla et al., 2006). This 
percentage increased in 2004-05 and has 
been relatively constant since, likely due 
to the large increase in the number of 
identified Title I schools in 2004—05 and 
the relative stability of that number in 
2005-06 and 2006-07. 

Over the past five years, most of the 
districts that had at least one identified 
Title I school have very few identified 
schools. Of the 2,618 districts that had 
one or more identified Title I schools in 2006—07, 71 percent of these (1,871 districts) had only one or 
two identified Title I schools (see Exhibit 43). 



Exhibit 42 

Percentage of Districts That Had At Least One 
Title I School Identified for Improvement, 
2001-02 to 2006-07 




Exhibit reads: Twenty-one percent of districts with Title I 
schools had at least one Title I school that was identified for 
improvement for 2001—02. 

Sources: Evaluation of Title I Accountability Systems and School 
Improvement Efforts (2001—02 to 2003—04) and SSl-NCLB 
{n — 13,997 districts with at least one Title I school). 
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Exhibit 43 

Percentage of Districts With At Least One Title 1 School Identified for Improvement 
by Number of Identified Schools, 2002-03 to 2005-06 


Number of Identified 












Schools in the District 


2002-03 


2003-04 


2004-05 


2005-06 


2006-07 


1 school 


58% 


31% 


56% 


58% 


54% 


2 schools 


15% 


16% 


17% 


17% 


17% 


3 or 4 schools 


13% 


17% 


14% 


12% 


13% 


5 to 12 schools 


10% 


23% 


9% 


9% 


11% 


13 or more schools 


2% 


12% 


4% 


4% 


5% 


Exhibit reads: In 2002—03, 58 percent of districts with at least one identified Title I school had a single 
identified Title I school. 

Note: This exhibit includes only districts with at least one identified Title I school. 


Sources: Evaluation of Title I Accountability Systems and School Improvement Efforts (2002—03 and 2003—04) 


and SSl-NCLB National AYP and Identification Database (« = 
school). 


2,618 districts with at least one identified Title I 



The majority of identified Title I schools were concentrated in just over 1 percent of 
the nation’s Title I districts. 

With four-fifths of districts containing no identified schools and most of the rest containing only one or 
two identified schools, most identified Title I schools were concentrated in a small number of districts. 
Over half (53 percent) of all Title I schools identified for improvement were located in the 177 districts 
that each had 10 or more identified schools in 2006—07. 

Furthermore, about one-fifth (19 percent) of all Title I identified schools were located in just 15 school 
districts (see Exhibit 44). These districts were typically among the largest districts in the nation, and they 
also had relatively high proportions of their schools identified for improvement. Often, more than half 
of Title I schools in these districts were identified for improvement. In California, Florida, 
Massachusetts, and Alaska, there was one district with 10 or more Title I schools where 100 percent of 
Title I schools were identified for improvement for 2006—07. 

Schools in restructuring status were particularly likely to be concentrated in a small set of districts; the 
15 districts with the most Title I schools in restructuring status accounted for 37 percent of all Title I 
schools in restructuring status in 2006—07 (see Exhibit 44). Again, the districts with the largest number 
of restructuring schools were often the districts with the largest number of schools overall. This fact 
could be interpreted as an indication that large districts had the largest school improvement needs, but 
the story is more complex. For instance, if one looks at the percentage of schools in each district that 
were in restructuring, some very large districts like New York and Los Angeles had fewer than 1 out of 5 
of their Title I schools in restructuring while moderate size districts like Gallup-McKinley and Buffalo 
had higher proportions (1 out of 2) of their schools in restructuring. 
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Exhibit 44 

Number and Percentage of Title 1 Schools Identified for Improvement and 
Restructuring in the 15 Districts With the Largest Numbers of Such Schools, 2006-07 


Title 1 Schools Identified for Improvement 


Title 1 Schools in Restructuring Status 


District 


n 


Percentage 


District 


n 


Percentage 


Chicago, III. 


343 


77% 


Chicago, III. 


225 


51% 


New York, N.Y. 


337 


28% 


New York, N.Y. 


182 


15% 


Los Angeles, Calif. 


309 


49% 


Los Angeles, Calif. 


79 


15% 


Hawaii 


143 


17% 


Hawaii 


53 


26% 


Dade County, Fla. 


139 


56% 


Philadelphia, Pa. 


49 


19% 


Washington, D.C. 


103 


53% 


Baltimore City, Md. 


42 


37% 


Boston, Mass. 


89 


71% 


Detroit, Mich. 


28 


14% 


Hillsborough County, Fla. 


88 


72% 


Fresno, Calif. 


28 


30% 


Palm Beach County, Fla. 


77 


75% 


San Bernardino, Calif. 


24 


39% 


Philadelphia, Pa. 


75 


29% 


Memphis, Tenn. 


22 


12% 


Detroit, Mich. 


70 


36% 


Denver, Colo. 


21 


18% 


Columbus, Ohio 


67 


49% 


San Diego, Calif. 


20 


13% 


Fresno, Calif. 


63 


68% 


Buffalo, N.Y. 


20 


46% 


Broward County, Fla. 


60 


52% 


Oakland, Calif. 


18 


18% 


Oakland, Calif. 


58 


57% 


Gallup-McKinley Co., 
N.M. 


18 


53% 


Percentage of all identified 
schools 


19% of 10,781 


Percentage of all 
restructuring schools 


37% of 2,270 


Exhibit reads: In 2006—07, Chicago, 111., had 343 Tide 1 schools identified for improvement 
representing 77 percent of all Tide I schools in the district. 

Source: SSl-NCLB, National AYP and Identification Database (based on 50 states, the District of Columbia, and 
Puerto Rico). 



Differences in school identification rates by school characteristics 

Previous studies have found that the probability that a school was identified for improvement varied 
significantly by such characteristics as grade level, poverty level, minority level, size, and urbanicity. The 
U.S. Government Accountability Office (GAO) reported that proportionately more middle and high 
schools than elementary schools were identified for improvement for 2003—04 (GAO, 2004). The GAO 
also found that proportionately more schools in urban and suburban areas than in rural areas were 
identified for improvement and that identified schools enrolled larger proportions of minority students 
and students from low-income families than other schools. Padilla et al. (2006) also found that the 
probability of a school being identified for improvement was higher for schools in large, urban, and 
high-poverty districts. Novak and Fuller (2003) found that the greater racial or ethnic diversity of 
students in a district translates into districts being held accountable for more subgroups, resulting in a 
lower likelihood of making AYP and, eventually, a greater likelihood of being identified. This study’s 
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findings for 2004—05 (LeFloch et al., 2007), 2005—06 (Stullich et al., 2007), and again for 2006—07 are 
consistent with these previous studies. 67 

High-poverty, high-minority, and middle schools, and large urban schools, were 
most likely to have been identified for improvement for 2006-07. 

The same types of schools that were most likely not to make AYP (see Chapter III) were also most likely 
to be identified for improvement. Tide I schools with higher proportions of low-income and minority 
students were more likely to have been identified for improvement than Title I schools with lower 
proportions of such students (see Exhibit 45). Thirty-seven percent of the high-poverty schools were 
identified for improvement, compared with 4 percent of low-poverty schools. Similarly, 38 percent of 
schools with a high concentration of minority students were identified for improvement, compared with 
5 percent of low-minority schools. Urban Title I schools located in central cities (25 percent) were more 
likely to be identified for improvement than their counterparts in suburban and large towns (12 percent) 
or rural areas and small towns (9 percent). 



Exhibit 45 

Percentage of Title I Schools Identified for Improvement, by 
School Poverty Level, Minority Level, and Urbanicity, 2006-07 

100% 




HI 75 percent or greeter poverty 

J 35 to <75 percent poverty 
J 0 to <35 percent poverty 



75 percent or greater minority Central city 

_j 25 to <75 percent minority ^ | Urban fringe/large town 

0 to <25 percent minority | | Rural/amall town 



Exhibit reads: Thirty-nine percent of Title I schools with poverty rates of 75 percent or greater were 
identified for improvement for 2006—07, compared with 6 percent of schools with poverty rates below 
35 percent. 

Sources: SSl-NCLB, National AYP and Identification Database, and Common Core of Data, 2005-06 (based on 
data from 50 states, the District of Columbia, and Puerto Rico for 53,599 schools). 



67 These analyses include both Title I and non-Title I schools. 
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Students from low-income families, minority students, and students from urban areas were more likely to 
attend schools identified for improvement than were other students. Twenty-six percent of students 
from low-income families attended schools identified for improvement for 2006—07, compared with 
1 8 percent of all students. Similarly, 29 percent of African-American students, 32 percent of Hispanic 
students, and 22 percent of Native American students attended schools identified for improvement for 
2006—07, compared with 9 percent of white students. Twenty-eight percent of students from urban 
areas attended schools identified for improvement for 2006—07, compared with 14 percent of suburban 
students and 12 percent of rural students (see Appendix C, Exhibit C.ll). In absolute numbers, the 
largest subgroup of students in identified schools was students from low-income families (5.2 million), 
followed by Hispanic students (3.2 million), white students (2.5 million), and African-American students 
(2.4 million). Overall, 8.6 million students attended identified schools in 2006—07 (see Appendix C, 
Exhibit C.12). 

Middle schools were more likely than elementary and high schools to be identified for improvement. 
Twenty-two percent of middle schools were identified for improvement, compared with 13 percent and 
14 percent of elementary and high schools, respectively (see Appendix C, Exhibit C.13, for this and 
other demographic analyses). 

Large Title I schools were more likely than small Title I schools to be identified for improvement. For 
example, schools with 601 or more students were much more likely to be identified than were schools 
with fewer than 600 students (see Exhibit 46). The likelihood of identification increased fairly steadily as 
the size of the school increased. 



Exhibit 46 

Percentage of Title 1 Schools Identified for Improvement, by School Size, 2006-07 


School Size 


Not Identified 


Identified 


Year 1 


Year 2 


Corrective Action 


Restructuring 


200 or fewer students 
(n = 9,143) 


90% 


10% 


5% 


3% 


2% 


1% 


201 to 400 students 
(n = 16,250) 


84% 


16% 


6% 


4% 


3% 


3% 


401 to 600 students 
(n = 14,621) 


78% 


22% 


8% 


5% 


5% 


4% 


601 or more students 
(n = 13,548) 


62% 


38% 


11% 


7% 


10% 


9% 


Exhibit reads: In 2006—07, 90 percent of Title I schools with 200 or fewer students were not identified for 
improvement, and 1 0 percent were identified. 

Note: Percentages may not add up to 100 percent because of rounding. 

Sources: SSl-NCLB, National AYP and Identification Database, and Common Core of Data (based on data reported 
by 50 states, the District of Columbia, and Puerto Rico for 53,562 schools in these states). 



Title I schools in the more advanced stages of improvement status were more likely 
to not make AYP for “all students” or for two or more subgroups than other Title I 
schools. 

Title I schools in corrective action or restructuring status were more likely than other Title I schools to 
not make AYP for the achievement of the “all students” group or for the achievement of two or more 
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subgroups. Specifically, 58 percent of Title I schools identified for corrective action for 2006—07, and 
65 percent of Tide I schools identified for restructuring, did not make AYP for the “all students” group 
(based on 2005—06 assessments), compared with 39 percent of schools that were identified for 
improvement for the first time, and 25 percent of schools that did not make AYP but were yet not 
identified for improvement. Conversely, 13 percent of Title I schools in corrective action and 
restructuring status did not make AYP for the achievement of a single subgroup, compared with 
35 percent of non-identified schools that did not make AYP for this reason (see Exhibit 47). 



Exhibit 47 

AYP Targets Missed by Title I Schools That Did Not Make AYP in 2005-06, 
by Stage of School Improvement Status for 2006-07 
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Exhibit reads: Among schools that did not make AYP based on 2005—06 assessments and were not 
identified for improvement in 2006—07, 25 percent missed an achievement target for the “all students” 
group. 

Note: Percentages may not add up to 100 percent because of rounding. 

Sources: SSl-NCLB, National AYP and Identification Database, and Common Core of Data (based on data reported 
by 50 states, the District of Columbia, and Puerto Rico for 12,785 Title I schools that did not make AYP in 2005—06 In 
these states). 



Districts Identified for Improvement 

The number of districts identified for improvement for 2006-07 was similar to the 
previous year, but the number of districts identified for corrective action increased 
five-fold. 

Although only 13 percent of Title I districts (1,728) were identified for improvement for 2006—07, these 
districts enrolled 40 percent of the nation’s students, or about 1 8 million students; a similar percentage of 
districts (10 percent) was identified in 2004—05 and 2005—06. However, in 2006—07 many more of these 
identified Title I districts moved into corrective action. Among the identified districts, 381 districts in 
26 states were identified for corrective action for 2006—07, a five-fold increase over 2005—06. 
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The rates at which states identified districts for improvement varied, ranging from no districts in five 
states to all districts in Florida (see Exhibit 48). Twenty-six states identified 10 percent or fewer of their 
districts, while twelve states identified a third or more of their districts. This variability reflects state 
differences in academic achievement standards, assessments, proficiency levels, district identification 
policies (e.g., districts are identified only if the district does not make AYP for two consecutive years at 
elementary, middle, and high school grade levels), district characteristics, levels of performance, and 
perhaps other factors. 



Exhibit 48 

Number and Percentage of Title 1 Districts Identified for Improvement, by State, 2006-07 


State 


Number 


Percent 


State 


Number 


Percent 


Total 


1,728 


13% 








Alabama 


43 


34% 


Montana 


44 


13% 


Alaska 


29 


57% 


Nebraska 


0 


0% 


Arizona 


54 


14% 


Nevada 


3 


<1% 


Arkansas 


2 


1% 


New Hampshire 


20 


2% 


California 


192 


20% 


New Jersey 


58 


4% 


Colorado 


63 


36% 


New Mexico 


34 


66% 


Connecticut 


28 


20% 


New York 


54 


5% 


Delaware 


2 


11% 


North Carolina 


64 


56% 


District of Columbia 


1 


1 00% 


North Dakota 


15 


8% 


Florida 


77 


100% 


Ohio 


69 


12% 


Georgia 


19 


10% 


Oklahoma 


7 


2% 


Hawaii 


0 


0% 


Oregon 


10 


6% 


Idaho 


67 


60% 


Pennsylvania 


19 


4% 


Illinois 


175 


22% 


Puerto Rico 


1 


1 00% 


Indiana 


32 


11% 


Rhode Island 


6 


18% 


Iowa 


15 


4% 


South Carolina 


27 


32% 


Kansas 


11 


4% 


South Dakota 


5 


3% 


Kentucky 


92 


53% 


Tennessee 


7 


5% 


Louisiana 


0 


0% 


Texas 


56 


5% 


Maine 


0 


0% 


Utah 


15 


32% 


Maryland 


2 


8% 


Vermont 


38 


22% 


Massachusetts 


149 


43% 


Virginia 


1 


1% 


Michigan 


12 


2% 


Washington 


32 


11% 


Minnesota 


48 


12% 


West Virginia 


21 


38% 


Mississippi 


5 


4% 


Wisconsin 


2 


1% 


Missouri 


0 


0% 


Wyoming 


2 


4% 


Exhibit reads: In 2006—07, 1,728 Title 1 districts were identified for improvement, representing 
13 percent of all Tide I districts. 

Sources: Education Data Exchange Network, Consolidated State Performance Reports, and SSl-NCLB, National 
AYP and Identification database (« = 13,327 Title I districts in 50 states, the District of Columbia, and Puerto Rico). 
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One quarter of identified districts contained no identified schools. 



Approximately 25 percent of identified districts in 2006—07 (431 districts) had no schools identified for 
improvement. Because district-level AYP calculations include students from all schools, districts may 
meet the minimum n sizes to calculate AYP for specific subgroups even if its schools do not. If such 
subgroups, when aggregated, do not make AYP at the district level but are too small to be counted at the 
school level, the result will be that districts with no identified schools will be identified for improvement. 

Such identification of districts ensures that an educational jurisdiction is held accountable for low rates 
of proficiency among these subgroups of students. On the other hand, because assistance is commonly 
focused on schools, this situation raises questions about how to provide support to identified districts 
which have no schools that have been identified for improvement. For instance, Title I school 
improvement funds are directed only to districts with schools that have been identified for improvement 
(see Chapter VIII for more information on state assistance to districts). 

Discussion 

Nationally, the numbers of schools and districts identified for improvement increased only slightly from 
2005—06 to 2006—07. However, both the number and percentage of identified schools and districts and 
the change in rate of identification differed from state to state. Some states identified one of every 20 of 
their schools, while others identified one out of every two. Although most districts with identified 
schools had only one or two identified schools, the 177 districts that each had more than 10 identified 
schools contained nearly half of all identified schools, and the 1 5 districts with the highest numbers of 
identified Title I schools contained a sixth of identified schools. These heavy concentrations of schools 
in need of improvement will test state and local improvement capacity. 

Although the total number of Title I schools identified for improvement increased only slightly, 
identified schools have shifted into the more advanced stages of improvement status — corrective action 
and restructuring. Nearly three-fourths (72 percent) of the schools that were identified for improvement 
for 2004—05 remained in improvement status in 2006—07, and most of these had progressed to more 
advanced stages of improvement status. We also observed a decline in the proportion of identified 
Title I schools that exited improvement status over these three years. The percentage of schools exiting 
from improvement status decreased from 23 percent in 2004—05 to 17 percent in 2005—06 to 12 percent 
in 2006—07. These trends have altered the distribution of identified schools across the various stages of 
improvement status, such that for 2006—07 almost half of identified Title I schools were in corrective 
action or restructuring status. These schools in the more advanced stages of improvement were more 
likely than other schools to not make AYP for the achievement of the “all students” group or for the 
achievement of two or more subgroups. Unfortunately, there is little evidence on which strategies are 
effective in improving these persistently low-performing schools. Similarly, little is known about what 
exiting schools did to improve their AYP results or about what support they needed or received after 
exiting improvement status. 

Forty percent of the nation’s students attended schools in the 13 percent of districts that were identified 
for improvement. One-quarter of these identified districts did not include any identified schools; 
because district-level AYP calculations included students from all schools, low-performing subgroups 
may have been large enough to be counted at the district level, but too small to be counted at the school 
level. This way, school districts were held accountable for the achievement of student subgroups even 
when schools were small or the concentrations of students from low-income families, minority students, 
disabled students, or LEP students were small. 
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V. ENSURING PROGRESS FOR STUDENTS WITH LIMITED 
ENGLISH PROFICIENCY: TITLE III ACCOUNTABILITY 



Over the past decade, concern over how best to meet the needs of students with limited proficiency in 
English (LEP students) has increased along with the number of these students in U.S. schools. To 
address the growing numbers, and the linguistic and academic needs of LEP students, NCLB includes 
provisions to ensure that LEP students gain the English language skills they need to meet state standards 
and be successful in school. Title III of the LLlementary and Secondary Education Act (ESEA) contains 
specific requirements to address the needs of LEP students. 



Key Findings 

• All states had implemented English language proficiency (ELP) standards by 
2006—07, with the majority implementing their current standards after the 2003—04 
school year. 

• By 2006—07, nearly all states reported that they had implemented ELP assessments 
aligned with state ELP standards; almost half of the states developed their ELP 
assessments in collaboration with a multistate consortium. 

• By 2006—07, 12 states had finalized their AMAO targets, while over half were in the 
process of revising them. Nearly half the states calculated and reported AMAOs for all 
districts with LEP students rather than only those receiving Tide III funds. 

• In 2006—07, over half the states were applying accountability actions to districts 
that had not met their AMAO targets for consecutive years. However, due to delays 
in the development of ELP standards, assessments, and AMAOs, some states were not 
yet imposing consequences. 

• Although the majority of states provided technical assistance (to some or all 
districts) to improve education for LEP students in 2006—07, half of all schools that 
reported needing such assistance did not have their needs met. 



In 2004—05, an estimated 5.1 million LEP students were enrolled in U.S. public schools, 68 an increase of 
61 percent over 1994— 95. 69 NCLB mandates that students meet state standards, that classrooms in core 
subjects be staffed with highly qualified teachers, and that parents be notified of their child’s progress, to 
the extent practicable, in a language that the parents can understand. These requirements may present 
unique challenges in curriculum and assessment design, professional development, human and financial 
resource allocation, teacher certification, and communication between the school and LEP family 
members. These challenges can be magnified by the sheer numbers of LEP students to be served. 
California alone, for example, educates more than 1.5 million such students. In other cases, the 



68 This figure does not include Puerto Rico because most of the Puerto Rican student population is made up of native 
Spanish speakers. In Puerto Rico, Title III primarily targets students with limited Spanish proficiency. Even though 
Title III in Puerto Rico differs significantly from Title III in the other 50 states and the District of Columbia, the basic 
NCLB requirements for non-native -language-speaking students are the same, so Puerto Rico is included in this report’s 
discussion of the implementation of Title III program. 

69 While this section provides background information on LEP students in U.S. schools more generally, the focus for 
this chapter is primarily on those LEP students served by Title III — that is, LEP students enrolled in districts receiving 
Title III funds. 
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challenges may derive less from the total number of LEP students than from a sharp increase in the 
percentages of students for whom appropriately trained staff and materials may be lacking. 

Public schools in every state enroll LEP students, although the percentages vary across states. In 
2004—05, LEP students constituted more than 10 percent of total enrollment in 12 states, 5—10 percent 
in 11 states, and 1—5 percent in 25 states. California had the largest number of LEP students 
(approximately 1.5 million), as well as the largest percentage of students who were LEP (31 percent). 
New York, Florida, and Texas followed with approximately 234,578; 253,165; and 640,749 LEP 
students respectively (see Exhibit 49). 



Exhibit 49 

Total Number of Enrolled LEP Students, by State, 2005-06 


State 


2005-06 


State 


2005-06 


Alabama 


16,520 


Montana 


6,952 


Alaska 


20,514 


Nebraska 


14,966 


Arizona 


152,962 


Nevada 


74,305 


Arkansas 


20,320 


New Hampshire 


4,179 


California 


1,571,463 


New Jersey 


42,940 


Colorado 


84,049 


New Mexico 


64,860 


Connecticut 


27,678 


New York 


234,578 


Delaware 


6,015 


North Carolina 


83,627 


District of Columbia 


4,485 


North Dakota 


5,529 


Florida 


253,165 


Ohio 


24,361 


Georgia 


56,465 


Oklahoma 


31,011 


Hawaii 


16,190 


Oregon 


65,824 


Idaho 


18,588 


Pennsylvania 


41,097 


Illinois 


204,803 


Puerto Rico 


na 


Indiana 


36,208 


Rhode Island 


10,000 


Iowa 


14,742 


South Carolina 


20,013 


Kansas 


25,995 


South Dakota 


5,275 


Kentucky 


10,171 


Tennessee 


20,901 


Louisiana 


7,740 


Texas 


640,749 


Maine 


3,146 


Utah 


52,582 


Maryland 


29,778 


Vermont 


1,564 


Massachusetts 


47,397 


Virginia 


72,380 


Michigan 


42,007 


Washington 


78,236 


Minnesota 


58,727 


West Virginia 


1,224 


Mississippi 


4,866 


Wisconsin 


40,522 


Missouri 


17,263 


Wyoming 


2,057 


Note: “na” means not available. 

This exhibit does not include Puerto Rico where most students are native Spanish speakers and the target 
Title III population is limited Spanish proficient students. 

Source: Consolidated State Performance Reports, 2005-06 (« = 50 states, the District of Columbia, and 
Puerto Rico). 
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In addition to the aggregate size of the LEP populations, increased growth rates in localities ordinarily 
without large populations of LEP students are becoming more common. The growth of LEP 
populations (as a proportional increase) has shifted from the states that traditionally have had larger LEP 
groups and thus may be more experienced in meeting their needs — such as California, Florida, and 
Texas — to states in the Southeast, Midwest, and interior West, for whom these issues are relatively more 
recent. 70 For example, Michigan’s LEP population grew at a rate of 62 percent in just one year (2004—05 
to 2005—06). In Louisiana, Mississippi, and West Virginia, where LEP students made up less than 
1 percent of the total enrollment, the growth rate for this same period was 17, 41 and 45 percent, 
respectively. 71 

Many states face the additional challenge of burgeoning numbers of LEP students at the secondary 
level. 72 During the 1990s, the secondary school LEP population grew by 64 percent, compared with 
46 percent growth at the elementary school level. However, data from the NCES Schools and Staffing 
Survey indicate that LEP students at the secondary level are less likely to receive English as a Second 
Language (ESL) instruction or bilingual instruction than are elementary students. 73 

Another educational challenge is the linguistic composition of the LEP students in a state, district, or 
school — ranging from extreme linguistic diversity in some locales to comparative language isolation and 
de facto segregation in others. More than 400 languages are spoken by LEP students across the United 
States. The majority speak Spanish (79 percent) followed by Vietnamese (2 percent); Hmong 
(1.6 percent); Chinese, Cantonese (1.0 percent); Korean (1 percent), and other languages (15.4 percent). 74 
In some locales, certain languages may predominate, and in other areas the number of languages might 
be quite diverse. An individual school in some districts, for example, may enroll students speaking over 
20 languages, a situation that increases the complexity of communication with both students and parents. 
The communication difficulties can be particularly pronounced if students come from linguistically 
isolated households (i.e., households where one language is spoken) or communities. In 2000, six out of 
seven LEP children in grades 1 to 5 lived in linguistically isolated households; in secondary school, two 
out of three LEP children did so. 75 

Finally, many LEP students face not only the challenges of learning a new language, but also those that 
derive from poverty as well. In 2000, 68 percent of LEP children in grades PK— 5 were low-income, as 
were 60 percent of LEP children in grades 6—12. These rates were nearly twice as high as the rates for 
English proficient children in comparable grades. 76 

To address the growing numbers and the linguistic and academic needs of LEP students, NCLB includes 
provisions to ensure that students with limited English proficiency gain the English language skills they 
need to meet the state standards and be successful in school. This chapter describes these provisions, 
and the state implementation of these provisions during the 2005—06 school year. 



70 Cosentino de Cohen, Deterding and Clewell (2005). 

71 National Clearinghouse for English Language Acquisition and Language Instruction Educational Programs Web site 
(accessed October 2007), and Consolidated State Performance Reports, 2004—05 and 2005-06. 

72 Capps et al. (2005). 

73 Ruiz-de-Velasco, Fix, and Clewell. (2000). 

74 National Clearinghouse for English Language Acquisition and Language Instruction Educational Programs Web site, 
(accessed October 2007) 

75 Capps et al. (2005). 

76 Cosentino de Cohen et al. (2005). 
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Title III Provisions Under NCLB 



NCEB is not the first attempt to address the needs of LEP students through ESEA. In 1968, three 
years after its initial passage, ESEA was amended to include Title VII, the Bilingual Education Act. 
Federal policy recognized bilingual education as a viable instructional method for economically 
disadvantaged language minority 77 students and drew attention to the unique educational challenges of 
non-English speaking students with the passage of Title VII. 78 Title VII underwent several amendments 
through the 1970s, 80s, and 90s, expanding funding within the competitive grant structure by increasing 
emphasis on professional development for teachers and by moving toward a focus on the acquisition of 
English and away from bilingual education. 79 

In 2001, NCEB replaced the Title VII provisions with Title III, changing the funding stmcture from 
competitive grants to formula grants 80 to states and adding provisions focused on “promoting English 
acquisition and helping English language learners meet challenging content standards.” 81 

Explicit accountability for outcomes of LEP students is a new requirement of ESEA and is incorporated 
in both Titles I and III of NCEB. Title I requires that states develop and implement academic standards, 
aligned assessments, and AYP targets in reading and mathematics (see Chapter I of this report). 82 LEP 
students are to be included in these state assessments and in the “all students” category for evaluating 
school and district attainment of AYP targets. In addition, schools and districts with sufficiently large 
LEP student populations 83 are held accountable for ensuring that the LEP subgroup also meets AYP 
targets. Title III provisions may be seen to parallel Title I regulations, with the goal of LEP students 
attaining both English language proficiency and academic achievement. In order to determine whether 
or not LEP students are making sufficient progress in learning English, NCEB requires states to 
establish English language proficiency (ELP) standards and aligned assessments (distinct from state 
academic content standards and assessments in English language arts) and to measure progress toward, 
and attainment of, those standards for their LEP student populations. District and state progress is 
evaluated against Annual Measurable Achievement Objectives (AMAOs), and all districts receiving Title 
III funds are to be held accountable for meeting state-established AMAO targets each year (see Exhibit 
50). 

English language proficiency standards 

States’ ELP standards differ from English Language Arts (ELA) standards in both their purpose and 
their content. Designed to guide development of English proficiency for students from a different 
primary language background, ELP standards must define competence in speaking, listening, reading, 



77 A person or language community that is not from the dominant language group. In the U.S., a language-minority 
child may be bilingual, limited-English proficient, or English monolingual. National Clearinghouse for English 
Language Acquisition and Language Instruction Educational Programs. 

http:/ /www.ncela.gwu.edu/expert/glossary.html#L (accessed October 2007). 

78 National Clearinghouse for English Language Acquisition and Language Instmction Educational Programs, 
http:/ / www.ncela.gwu.edu/policy/ l_history.htm (accessed October 2007). 

79 Ibid 

80 Competitive grants usually are replaced by formula grants when available funds are increased. 

81 National Clearinghouse for English Language Acquisition and Language Instmction Educational Programs, 
http:/ / www.ncela.gwu.edu/policy/ l_history.htm (accessed October 2007) 

82 States must also establish standards and aligned assessments in science, but these are not currently included in AYP 
targets. 

83 States may establish a minimum number of students required for determining subgroup accountability. See Chapter II 
for a discussion of minimum n policies across the states. 
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and writing in English 84 and must set clear levels of progress (English proficiency levels) that reflect the 
differences in each student’s grade level and English language abilities. Proficiency levels must include a 
descriptor (such as novice or intermediate) and there must be an assessment cut score corresponding to 
each level. 



Exhibit 50 

Title 1 and Title III Provisions Under NCLB 


Provision 


Title 1 


Title III 


Standards 


English Language arts, mathematics, 
and science 


English language proficiency for LEP students 


Assessments 


Academic assessments AND an ELP 
assessment 


ELP assessment (can be same instrument used 
for Title l) a 


Measuring 

progress 


Adequate Yearly Progress (AYP) 

(to measure progress of all students 
toward meeting the state’s standards in 
English language arts and 
Mathematics) 


Annual Measurable Achievement Objectives 
(AMAOs) 

(to measure progress of LEP students in Title III 
districts toward meeting ELP proficiency and 
subject matter standards) 


a While the ELP assessment used for Title III may be the same instrument used for Title I purposes. Title III 
requires that the assessment be aligned with the state’s ELP standards. No such explicit requirement exists for 
Title I, as there are no ELP standards required under Title I. 

Source: Title III Non-regulatory Guidance, U.S. Department of Education (2003). 



NCLB requires that the ELP standards be aligned with the achievement of state academic standards in 
the content areas. The goal is to ensure that LEP students are learning the type of academic English 
necessary to make progress in core content. 

Assessments 

NCLB requires states to assess LEP students in English language proficiency in the four domains of 
reading, listening, speaking, and writing. 85 As for ELP standards, NCLB initially required states to have 
their ELP assessment(s) in place during the 2002—03 school year, but this deadline was extended by the 
U.S. Department of Education to spring 2006. 

Another important change in the testing requirements involves the time when students are required to 
take the ELA assessment in English. Initially, all students were required to participate in their state 
academic assessment system once they had enrolled in school. However, the U.S. Department of 
Education, “in support of state and local efforts for LEP students to achieve at high levels and to adjust 
to new surroundings,” 86 ruled that a recently arrived LEP student (a LEP student who has attended 
schools in the United States for less than 12 months 87 ) may be exempt from one — and only one — 



84 Comprehension, as exhibited through reading and listening, must be considered when states develop their English 
language proficiency standards (U.S. Department of Education, 2003b). 

85 Comprehension need not be assessed separately but may be reported as a composite of student scores in listening and 
reading. 

86 Title III Non-regulatory Guidance: U.S. Department of Education, March 2003. 
http://www.ed.gov/print/programs/ sfgp/nrgcomp.html (accessed June 2007). 

87 Does not have to be a consecutive 12 months but can be 12 months total (Assessment and Accountability for 
Recently Arrived and Former Limited English Proficient (LEP) Students: Non-Regulatory Guidance, U.S. Department 
of Education, May 2007. http://www.ed.gov/policy/elsec/guid/lepguidance.doc (accessed October 2007)). 
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administration of the state’s reading assessment. A newly arrived student must take the state’s ELP 
assessment, however, and must take the state’s mathematics or science assessments. 

Annual measurable achievement objectives 

States must report the progress of their LEP students in learning English, as defined by the state’s ELP 
standards and measured by the state ELP assessment. Progress is to be reported relative to the state’s 
AMAOs, 88 which include three criteria: 

• annual increases in the number or percentage of students showing progress in learning English; 

• annual increases in the number or percentage of students attaining ELP by the end of the school 
year; and 

• attainment of AYP targets in reading and mathematics for the LEP subgroup. 

The AMAOs hold districts receiving Tide III funds accountable for improving levels of English 
proficiency and academic performance of their LEP students. If a state determines that an applicable 
district has not met its AMAOs for two consecutive years, the district must develop an improvement 
plan with support from the state. If the district has not met AMAOs for four consecutive years, it must 
modify its curriculum, program, and method of instruction, or the state must assess whether the district 
should continue to receive funds and must also require the district to replace personnel relevant to the 
district’s failure to meet AMAOs. 

Implementing ELP Standards, ELP Assessments, and AMAOs 

The goal of Title III provisions under NCLB is to ensure that LEP students gain English language 
proficiency to keep pace with their English-speaking peers in academic content areas. To this end, 
IVCLB legislated that states develop and implement ELP standards, ELP assessments, and AMAOs for 
LEP students. This section discusses how the law has been implemented across the states. 

Implementing ELP standards 

Before the 2001 passage of NCUi, ELP standards were not required and very few states had developed 
them. Indeed, only 14 states reported that they had some form of such “standards” in place when the 
law was passed. Moreover, in each of these 14 states, Title III directors reported that ELP standards 
were not binding but instead served merely as guidance or curriculum aids. 

All states had implemented ELP standards by 2006-07, with the majority 
implementing their current standards after the 2003-04 school year. 

NCUi required states to establish ELP standards before or during the 2002—03 school year. Because so 
few states had prior experience setting such standards, very few were able to meet this deadline. 
Recognizing the need for flexibility, the U.S. Department of Education extended the deadline to the 
2005—06 school year. By 2004—05, after a slow start, 41 states had implemented ELP standards, and by 



88 The term annual measurable achievement objective refers to performance targets set specifically for LEP students served 
through Title III. This should not be confused with AMOs (annual measurable objectives), which are AYP targets for 
all students. 
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2006—07, all states, the District of Columbia, and Puerto Rico had implemented their ELP standards 
(see Exhibit 51). 



Three states implemented their ELP 
standards during the 1998-99 and 
1999—2000 school years, three states 
implemented them during the 2002—03 
school year, 1 3 states implemented in 
2003—04, while the majority of states 
implemented their standards after the 
2003—04 school year (29 states, the District 
of Columbia, and Puerto Rico). In 2006, 
state directors indicated that after their ELP 
standards were put in place, changes to these 
standards might include small revisions to 
ensure alignment with other content and 
academic standards as well as larger periodic 
revisions similar to those for other state 
standards (generally every five to seven 
years). 

Enhanced Assessment Grant Consortia 
provided support to some states in the 
development of ELP standards. In March 
2003, the U.S. Department of Education awarded Enhanced Assessment Grants under Section 6112 of 
ESEA. The purpose of these grants was to help states improve the quality of state assessments, with 
award preference going to states targeting assessments for LEP students and students with disabilities. 
Four of the recipients were multistate consortia that included approximately 38 states as of 2004—05: 

• The World-class Instructional Design and Assessment (WIDA) consortium; 

• The State Collaborative on Assessment and Student Standards (SCASS) Limited English 
Proficient (LEP) consortium (otherwise known as the LEP-SCASS); 

• The English Proficiency for All Students (EPAS) consortium; and 

• The Mountain West Assessment Consortium (MWAC). 

In addition to providing support to states in developing their ELP assessments, some of the consortia 
assisted states in developing their ELP standards. For example, states participating in the WIDA 
consortium actively used the consortium for the development of ELP standards as well as the ELP 
assessment. The LEP-SCASS and MWAC consortia also provided some support in developing 
standards, while EPAS concentrated on the development of state assessments. 

In 2004—05, more than half of state directors indicated that they were participating in one of the four 
consortia for ELP standards or assessment development. By 2006—07, 20 states and the District of 
Columbia had developed ELP standards with the support of a consortium. These states reported that 
they had either used a consortium as a resource, adopted a consortium’s ELP standards, or had adapted 
a consortium’s ELP standards for their own needs. Thirty states and Puerto Rico indicated that they had 
not used support from a consortium to develop their ELP standards. 



Exhibit 51 

Number of States, by First Year ELP Standards 
Were Implemented 




Number of States 

Source: SSl-NCLB, Title III Interviews (n = 48 states, the 
District of Columbia, and Puerto Rico. Data were not available 
for two states). 
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NCLB requires that the ELP standards be aligned with the achievement of state academic standards in 
the content areas. The goal is to ensure that LEP students are making progress not only in learning 
English in general but in learning the type of academic English that will lead to success in the content 
areas. Some state directors reported that they linked their ELP standards with state content and 
academic achievement standards with the support of endues such as state advisory board members, 
outside consultants, or consortia. The approach and methods used for this alignment differed widely 
across the states. 

Implementing ELP assessments 

By 2006-07, nearly all states reported that they had implemented ELP assessments 
aligned with state ELP standards; almost half the states developed their ELP 
assessments in collaboration with a multistate consortium. 

NCLB requires states to provide for an annual assessment of ELP in reading, writing, speaking, and 
listening. In 2004—05, implementation of ELP assessments was incomplete in 27 states. Although many 
states had some type of proficiency test for LEP students prior to NCLB, these tests were generally 
designed for placement purposes rather than to measure progress in acquiring language proficiency. 
Therefore, new tests had to be developed and implemented to meet NCLB requirements in many states. 

By 2006—07, 49 states, the District of 
Columbia, and Puerto Rico had implemented 
their ELP assessment(s) in compliance with 
NCLB requirements. One state anticipated 
implementing its ELP assessment in the 
2007-08 school year. Forty-four states, the 
District of Columbia, and Puerto Rico 
implemented their current assessments 
during or after 2004—05. Prior to 2004-05, 
only five states had implemented their 
current ELP assessments (see Exhibit 52). 

States had several available means for 
developing their assessments: states adopted 
an ELP assessment from an out-of-state 
source (four states and the District of 
Columbia); adapted assessments for their 
state from an out-of-state source (eight states 
and Puerto Rico); developed assessments 
specifically for or by the state (13 states); or 
developed their assessments in collaboration 
with a multistate consortium (23 states). Two states used multiple sources to develop their assessments. 
In the fall 2006—07, state directors considered their ELP assessments to be in place and anticipated 
making only small revisions to them or otherwise updating or further aligning them, when needed. 

To ensure that ELP assessments measured ELP standards, states conducted alignment studies. 
Twenty-six states conducted an independent study on the alignment of ELP standards, while 20 states 



Exhibit 52 

Number of States by First School Year 
Assessments Were Implemented 




Number of States 

Source: SS1-NCLB, Title III Interviews (« = 50 states, the 
District of Columbia, and Puerto Rico). 
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did not. Further, 20 states (not all of the same 20 states) also indicated that they conducted other 
alignment studies. 89 

Measuring progress for LEP students through AMAOs 

States must report the progress of their LEP students in learning English, as defined by the state’s ELP 
standards and measured by the state-adopted ELP assessment. Progress is to be reported relative to the 
state’s AMAOs. These AMAOs must apply at least to all districts receiving Title III funds and must 
encompass progress covering both core content and English language proficiency. 

Since the passage of Title III provisions under IVCLB, it was difficult for states to set AMAO targets as 
states faced challenges in implementing valid and reliable ELP assessments and ELP standards that were 
linked or aligned with state academic content standards, both of which are important in determining 
reasonable growth targets. Additionally, most states were using ELP assessments that were not designed 
to measure growth in language acquisition as required by NCLB, but developed for the placement of 
LEP students in classes specifically designed for LEP students. States that had no prior ELP assessment 
had to adopt an interim test that would assess LEP students annually while working on the development 
of assessments that were in line with NCLB requirements, most of which took several years to develop. 
Even though many states had such assessments in place in 2004—05 or were planning to have them in 
2005—06, most states indicated that their AMAOs would change in the next few years as they received 
new test data and created new baselines. 

By 2006-07, 12 states had finalized their AMAO targets, while over half were in the 
process of revising them. 

Title III directors in 11 states and the District of Columbia reported that their state’s AMAOs were put 
in place during the 2002—03 school year; 10 directors indicated that their state’s AMAOs were first 
established in 2003—04; five in 2004—05; seven each in 2005—06 and 2006—07; and two states AMAOs 
were to be implemented in the upcoming 2007—08 school year. 90 However, most states have been 
making revisions to their AMAOs. In 2006—07, over half of states and the District of Columbia were in 
the process of revising their AMAOs, while only 12 state directors reported they had finalHed these 
targets. In developing and revising their AMAOs, state directors reviewed several years of assessment 
data to determine how much progress an LEP student can be expected to make in a year’s time. 
Thirty-seven states still anticipate amending their AMAOs. 

Calculating and Reporting AMAOs 

Nearly half the states calculated and reported AMAOs for all districts with LEP 
students rather than only those receiving Title III funds. 

States are required to calculate AMAOs for all districts receiving Title III funds. However, 25 states 
calculated and reported AMAOs for all districts with LEP students while fewer than half restricted the 
calculations only to districts receiving Title III funds. 91 One state calculated and reported AMAOs for 
both Title I and Title III districts. Twenty-five states reported AMAO data to the public. 



89 Source: Consolidated State Performance Reports, 2005-06; item 1.6.2. 

90 Source: Fall 2006 NLS-SSI interviews with state Title III directors. 

91 There can be an overlap of all districts with LEP students and districts receiving Title III funds. 
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Twenty- five states defined their AMAO cohorts 92 by grade span or level (e.g., states could set targets for 
grades spans such as K— 2, 3—5, 6—8 or individual grade levels), although six states and the District of 
Columbia used proficiency level, and four states used length of time in the U.S. or a formal schooling 
system to define their cohorts. The remaining states used other measures to define their cohorts, such as 
including all LEP students in the cohorts, comparing students across years, or using multiple measures 
such as grade level and length of time. 

Accountability for Meeting AMAO Targets 

Over half the states were applying accountability actions to districts that had not 
met their AMAO targets for consecutive years. However, due to delays in the 
development of ELP standards, assessments, and AMAOs, some states were not yet 
imposing consequences. 

The AMAOs hold districts receiving Tide III funds accountable for improving levels of English 
proficiency. If a state determines that an applicable district has not met its AMAOs for two consecutive 
years, the district must develop an improvement plan with support from the state. If the district has not 
met AMAOs for four consecutive years, the state must require the district to modify its curriculum, 
program, and method of instruction or assess whether the district will receive additional funds and be 
required to replace educational personnel relevant to not meeting these objectives. 

Nineteen state directors said they reported their AMAOs to the U.S. Department of Education and were 
aware of consequences for districts not meeting AMAOs. Due to the delay in the implementation of 
ELP standards, ELP assessments, and AMAOs as well as the questionable validity of the original 
AMAOs developed from inappropriate and nonaligned assessments, these 19 state directors were not 
holding districts accountable for missing AMAO targets. However, they indicated their intent to 
implement accountability measures once they have accurate data. 

All state directors were aware that if districts did not meet their AMAOs for two consecutive years, states 
would require districts to develop an improvement plan, provide technical assistance, and provide 
professional development as required by NCLJi. If districts did not meet their AMAOs for four 
consecutive years, states directors indicated they would provide specific program interventions, 
discontinue funding, replace educational personnel, and provide improvement grants as outlined under 
IVCLB. For states that are holding districts accountable, 1 1 were applying actions to all districts that did 
not meet their targets for the specified period, and 16 states were applying actions only to Tide III 
districts under these conditions. One state was targeting a subgroup of districts with a subgroup of 
actions. 



92 The Title III Notice of Final Interpretations released by the U.S. Department of Education on Oct. 17, 2008, specifies 
that states may now “set separate targets for separate groups or ‘cohorts’ of LEP students served by Title III” based only 
on the amount of time (for example, number of years) such students have had access to language instruction educational 
programs. In addition, the Notice of Final Interpretations indicates that states will not be allowed to apply minimum 
group sizes to separate cohorts for the purposes of Title III accountability. 
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Providing State-Supported Technical Assistance 



Under NCLB ’s Tide III provisions, the responsibilities of the state education agencies are to provide 
technical assistance to subgrantees in implementing Title III program services. 93 States are to provide 
technical assistance to subgrantees in: 



• identifying and implementing language instruction education programs (LIEP) and curricula that 
are based on scientific research; 

• helping LEP children meet the same challenging state academic content and student academic 
achievement standards as all children are expected to meet; 

• identifying or developing, and implementing, measures of English proficiency; and 

• promoting parental and community participation in programs. 



Although the majority of states provide technical assistance (to some or all districts) 
to improve education for LEP students, half of all schools that reported needing 
such assistance did not have their needs met. 

In 2006—07, Tide III directors from 45 states reported that their state provided technical assistance for 
improving education for LEP students. Technical assistance was provided primarily by state 
departments of education (in 45 states), but also included external contractors used by the state 
(28 states), districts (22 states), and regional teams in the state (18 states). Assistance was also provided 
by Title III directors, state service centers, and universities (8 states). 

Targets for this technical assistance differed somewhat across the states. Thirty-eight states provided 
support to all districts with LEP students; five provided it only to Tide III districts, and five said they 
provided assistance regardless of LEP population. No state reported that it restricted technical 
assistance to districts with a specified number or percentage of LEP students. Technical assistance was 
also provided by states at the district and school levels to district administrators (45 states), school 
administrators (40 states), and teachers (25 states). The majority of technical assistance was given based 
on the needs of the districts (42 states). 

Most states reported that the focus of their technical assistance included understanding and using 
assessments (44 states), managing and interpreting data (42 states), complying with NCLJ5 requirements 
relevant to LEP students (40 states), providing professional development for teachers (26 states), 
improving instructional methods (4 states), and selecting and identifying effective curriculum (1 state). 
The mechanisms for the delivery of this technical assistance varied, but generally included multiple 
formats: visits to districts (46 states), conferences, meetings, or institutes (46 states), the Web (42 states), 
and telephone and e-mail contact (34 states). 

Although Title III only requires states to provide technical assistance to Title III sub-grantees (districts), 
the results of the NLS -NCLJ3 survey provide insight into the need and availability of such assistance at 
the school level as well. About one-third of schools nationwide reported needing technical assistance to 



93 The study defined “state-supported technical assistance” as assistance that is funded by the state, but it can also 
include assistance delivered by organizations on behalf of the state, such as regional agencies. Professional development 
focuses directly on improving teachers’ knowledge, skills, and instructional practices in the core content areas. For more 
information on professional development, see Birman et al. (2007). See Chapter VII for a discussion of general technical 
assistance provided by the state. 
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meet the needs of LEP students in 2005—06 or 2006—07, about one-quarter of these schools did not 
receive such assistance (from any source), and about one quarter of the schools that did receive it were 
not satisfied that the assistance they received was sufficient to meet their needs (see Appendix C, Exhibit 
C.13). 94 Overall, about one-half of the schools that needed technical assistance to improve services for 
LEP students did not have their needs met. 

Schools identified for improvement under Title I were more likely to report needing assistance to meet 
the needs of LEP students than were non-idendfied schools in 2005—06 or 2006—07 (see Exhibit 53). 
Similarly, schools with the higher proportions of low-income students reported needing this technical 
assistance at higher rates than schools with lower proportions. Schools that needed technical assistance 
in this area were equally likely to receive it regardless of their characteristics. 



Exhibit 53 

Percentage of Schools Needing Technical Assistance in 2005-06 or 2006-07 to Meet 
the Needs of Limited English Proficient Students, by School Characteristic 



By Title i 
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Exhibit reads: Thirty-three percent of non-identified schools reported needing technical assistance 
addressing the needs of LEP students, compared with 52 percent of schools in Year 1 or Year 2 of being 
identified for improvement. 

Source: NLS-1VCLB, Principal Survey (« = 1,392 schools). 



94 Note that this technical assistance may have been provided either through Title I funds or in conjunction with 
technical assistance for Titles I and II. 
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In 2006—07, 50 percent of teachers in identified elementary schools reported receiving assistance to meet 
the needs of LEP students but only 36 percent of teachers in non-identified elementary schools reported 
receiving such assistance. There were no differences between identified and non-identified schools in 
the percentage of secondary English teachers (44 percent), secondary mathematics teachers (37 percent), 
and special education teachers (31 percent) who received professional development assistance related to 
LEP students. 

Discussion 

States have been moving forward in their development and implementation of the Title III provisions 
and have made considerable effort toward putting statewide processes in place for meeting the needs of 
LEP students. Despite this progress, implementation of the standards-based components of Title III — 
ELP standards, aligned ELP assessments, and AMAO targets and accountability actions — has not yet 
caught up with the implementation of similar provisions in the content areas covered by Title I. The 
differences in implementation trajectories between the two Tides can be attributed to a number of 
factors and challenges. Chief among these is the fact that very few states had ELP standards and aligned 
assessments in place prior to the enactment of NCUi. By contrast, states had at least seven years 
working toward this goal with respect to reading and mathematics under L4SA. Moreover, before 2002, 
even states that did have ELP standards were mosdy using them for general guidance or as curricular 
aids rather than for accountability purposes. As for ELP assessments, states often administered multiple 
assessments to place LEP students in courses. Many of these assessments were not valid or reliable for 
measuring progress in acquiring English as required by NCUi. Finally, states reported that they had not 
received consistent methods or specific criteria for developing key Tide III provisions. 

Although these challenges delayed implementation of Tide III, states did move forward to finalize their 
ELP standards and assessments and revise their AMAOs based on valid and reliable assessments. By 
2006—07, all states had their ELP standards in place and nearly all had finalized their ELP assessments. 
Lacking sufficient accumulation of data on student progress using these assessments, most states were 
still in the process of revising their AMAO targets. Because of this delay in finalizing valid AMAOs, 
some states had not begun imposing consequences on districts for not meeting AMAO targets, but 
planned to do so once the AMAO targets become finalized. 
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VI. PROVIDING INFORMATION ABOUT SCHOOL 
PERFORMANCE TO STAKEHOLDERS 

To help schools and districts reach NCUi accountability goals, clear and accurate information about 
performance must be communicated in a timely manner to key stakeholders (including district and 
school personnel, parents, policymakers, and the public). Key NCLJi information includes whether or 
not students met state academic achievement standards during a specific school year and whether a 
school made AYP and for which groups and indicators. Stakeholders also need to know whether or not 
a school has been identified for improvement, corrective action, or restructuring, so that appropriate 
actions can be taken. In addition, improvement efforts can be more appropriately targeted if 
stakeholders have all pertinent information sufficiently before the school year begins so that action can 
be taken. The responsibility for producing and distributing this information falls on states and districts; 
the responsibility for acting on the information is shared by states, districts, schools, teachers, and 
parents. 



Key Findings 

• States reported performance results from 2005—06 more quickly than for 2003—04. 

Forty-four states, the District of Columbia, and Puerto Rico delivered preliminary 
notification to schools identified for improvement before September 2006, an increase from 
31 states in 2003—04. 

• States have made progress since 2004—05 in developing systems capable of measuring 
the progress of individual students. In 2006—07, 41 states had data systems with both 
student identifiers and the ability to evaluate test scores in multiple years. 

• Since 2003—04, states have continued to enhance their reporting capabilities to align 
their practices with NCLB requirements. However, disaggregated graduation rates and 
teacher quality data remained absent from many state report cards. 

• While 2005—06 state report cards proved easier to find online and to understand than 
those from 2003—04, district reports remained challenging to locate online. 

• In 2006—07, nearly all principals knew whether their schools made AYP (90 percent) 
or were identified for improvement (94 percent). Teachers, although more alert to their 
schools’ accountability status in 2006—07 than in 2004—05, remained less knowledgeable than 
principals about their school’s status. 



State Data Systems and Reporting 

Providing the necessary information to stakeholders about school performance and other key factors 
requires data management systems that can track student characteristics, enrollment, achievement, and 
graduation, as well as other variables. States must also be able to administer and score assessments, 
conduct AYP calculations, and report these results between their testing periods and the start of the 
following school year. Districts, too, must issue report cards that include data on assessment results, 
accountability, and teacher quality. 
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Accurate and timely information brings transparency to educational policies, uncovers academic 
problems and deficits, and highlights areas in which schools have made gains. When parents have 
information about the schools their children attend, they can make better decisions concerning their 
children’s educational futures, become more effective advocates for their children’s schools and school 
systems, assuage their own concerns, and bolster their demands for change. When taxpayers are 
informed about the schools they fund, they can celebrate progress, pinpoint problems, and determine to 
their own satisfaction whether or not public funds have been well spent. And when administrators and 
teachers have access to accurate performance data, they can focus on the areas in which there are 
problems and tailor their improvement efforts to those concerns. 

By 2006—07, states had increased the capacity of their data systems to generate the information required 
by NCLB, improved the timeliness of their data reporting, and advanced their capacity to report 
disaggregated achievement data compared to 2004—05. 

States reported performance results from 2005-06 more quickly than for 2003-04. 

To take appropriate action most efficiently in response to being identified for improvement, schools, 
districts, and parents must receive this information prior to the start of the school year. As underscored 
by one state official, “[Timely release of performance data] allows [districts and schools] to respond very 
quickly once they get our data because then they know, [for example], if they’re going to have to get 
choice letters and those kinds of things accomplished in a very quick fashion.” 

For the accountability information based on 2005—06 testing, 44 states, the District of Columbia, and 
Puerto Rico delivered preliminary notification to schools identified for improvement before September 
2006, an increase from 31 states in 2003—04 (see Exhibit 54). Likewise, states improved the timeliness of 
final determinations of schools identified for improvement. Twenty-six states and the District of 
Columbia released final data to schools before September 2006. Seventeen states and Puerto Rico 
provided final data to schools in October or later, down from 33 states in 2004—05. While the improved 
timeliness represents an encouraging development, roughly one-third of states were still finalizing 
calculations and processing appeals well into the school year. 

In 40 states and the District of Columbia, final determinations were rendered within two months of the 
release of preliminary notifications. Seven states reported having different notification dates for 
elementary and middle schools and high schools. 95 In all but one of these states, elementary and middle 
schools were informed before high schools — typically one to two months earlier. In the lone instance in 
which high schools were notified prior to elementary and middle schools, there was a gap of four 
months. 

The reports from school principals indicated a similar trend: nearly two-thirds of principals (62 percent) 
reported that they were first notified of their school’s AYP status before September 2006, compared to 
56 percent in 2004—05 (see Exhibit 55). 



95 These states were: Connecticut, Illinois, Maryland, Michigan, New York, Rhode Island, and Vermont. For reporting 
and analysis purposes, in these instances in which elementary, middle, and high schools were notified in different 
months, the earlier of the two notification dates were used for each state in the analyses for this report. 
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Exhibit 54 

Number of States Providing Preliminary and Final Notification of School 
Improvement Status, by Month of Notification, 2004-05 and 2006-07 
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Exhibit reads: Seven states released preliminary accountability designations to schools in July 2004 or 
earlier and 24 states released preliminary designations in July 2006 or earlier. 

Note: If states released accountability results at different dates for elementary and high schools, the earlier month was 
counted for the purpose of this chart. 

Source: SSl-NCLB accountability interviews and extant sources (» = 50 states and Puerto Rico in 2004—05; n = 50 
states, the District of Columbia, and Puerto Rico in 2006-07). 



Exhibit 55 

Percentage of Schools Notified of Their AYP and Improvement Status by Month, 2006-07 
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Exhibit reads: Twenty-two percent of all schools were notified of their AYP status in June 2006 or earlier. 

Source: N I S-NCLB, Principal Survey (« = 1,392 schools). 
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States have made progress since 2004-05 in developing student data systems to 
measure the progress of individual students. 



In accordance with NCLB requirements, states must collect and disseminate disaggregated student 
achievement and school accountability results once each year. Although not mandated by NCLB, the 
capacity to track the progress of individual students has garnered increased attention in recent years. 
Providing data on academic growth provides more substantial insight on which to base instructional and 
other policy-related decisions. To this end, states must have the ability to link individual student test 
scores over time. This requires data systems with two critical elements: (1) unique student identifiers 
(e.g., identification codes for each student) that follow students across years and (2) the ability to match 
individual students’ test records from year to year (Data Quality Campaign, 2006). 



In 2006—07, 41 states had data systems with both necessary components, up from 32 states in 2005—06 
and 16 in 2004—05 (see Exhibit 56). An additional seven states had data systems with one of the two 
elements in 2006—07; four used student identifiers and three had the ability to evaluate test scores in 
multiple years. The inclusion of these elements offers tangible benefits to key stakeholders. As one state 
official explained: 



[We are] so glad that we have a unique 
student ID system and the data 
infrastructure that we have. . . [I]t has 
forced our schools to make. . .good and 
appropriate use of data. . .In the past, 

[data provided to schools] have been 
[disjointed]. This system, what we’ve 
done is we’ve kind of captured all of the 
data for them and put it in a cohesive 
system that they can use in better and 
more appropriate ways. 

State Report Cards 

Under NCLB, states are required to produce 
annual state-level report cards, which should 
include assessment trend data, graduation rates, 
district accountability information, school-level 
accountability information (names of schools 
and overall numbers), percentage of classes 
taught by highly qualified teachers, and 
percentage of teachers on emergency 
credentials — with most variables disaggregated 
by student subgroup. In addition, states “shall ensure that each local educational agency collects 
appropriate data and includes in the local educational agency’s annual report” the data required by NCLB 
(Title I, Sec. 1111). Hence, the legal responsibility for ensuring full compliance with NCLB state, district, 
and school-level reporting requirements lies with the state. 



Exhibit 56 

Number of States With Data Systems With 
the Ability to Track Individual Student Test 
Scores Over Time, 2004-07 




Number of States 



Exhibit reads: In 2003-04, 14 states had data 
systems with the ability to track individual student 
test scores over time. 

Source: Data Quality Campaign (2004-2006) ( n = 48 
states, the District of Columbia, and Puerto Rico). 
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Since 2003-04, states continued to enhance their reporting capabilities to align their 
practices with NCLB requirements, demonstrating progress in reporting data 
disaggregated by student subgroups and district AYP performance. However, 
disaggregated graduation rates and teacher quality data remained absent from 
many state report cards. 

Inclusion of achievement data disaggregated by student subgroups was nearly a universal pracdce in 
2005—06 state report cards. Fifty states, the District of Columbia, and Puerto Rico reported on student 
performance in mathematics and English language arts for all students, economically disadvantaged 
students, students with disabilities, white non-Hispanic students, and Hispanic or Latino students; only 
Puerto Rico did not provide data on African-American students. Forty-eight states and the District of 
Columbia reported on the percentage of limited English proficient students achieving at the proficient 
level, 96 and 45 states and the District of Columbia reported on the performance of American Indian, 
Native American and Asian students. In addition, student assessment results were provided by 45 states, 
the District of Columbia, and Puerto Rico; 43 states and the District of Columbia reported on migrant 
students. Eleven states and Puerto Rico provided data on students classified as multiracial or other. 

Several other indicators were featured commonly in state report cards. For instance, NCU3 requires 
state report cards to include data on district AYP performance, an element which 46 states, the District 
of Columbia, and Puerto Rico provided in 2005—06, compared to 31 states and Puerto Rico in 2003—04. 
Reporting on the names of schools identified for improvement has remained consistently high: Forty- 
two states and the District of Columbia in 2003—04 and 40 states, the District of Columbia, and Puerto 
Rico in 2005—06. 

Data on teacher quality and other NCUi requirements, although reported in more state report cards in 
2005—06 than in 2003—04, continued to lag behind other indicators. In 2005—06, 37 states, the District 
of Columbia, and Puerto Rico provided information on the percentage of core academic area classes that 
were not taught by highly qualified teachers, an increase from 18 states in 2003—04. Comparisons of 
student achievement to AYP targets were offered by 29 states and the District of Columbia in 2005—06 
compared to only 16 states in 2003—04. Fewer states did not offer data on disaggregated graduation 
rates: twenty-five states, the District of Columbia, and Puerto Rico did not provide graduation rates by 
subgroups. 

While 2005-06 state report cards proved easier to find online and to interpret than 
those from 2003-04, they remained challenging to locate online. 

A review of state education agency Web sites conducted by the SSI-NCLB team in spring 2007 revealed 
that state report cards were more accessible and clear than they had been at the time of the previous 
review, conducted in summer 2005. For example, 46 states provided a direct link to the state report card 
on their state department of education home page by spring 2007, an increase from 26 states in 2005. 
Similarly, 44 states and the District of Columbia included all state report card information in a single 
location (i.e., in a single file or with all relevant links on a single Web page) and 40 states, the District of 
Columbia, and Puerto Rico offered straightforward online access to state report cards (i.e., files available 
in PDF format or required minimal navigation) in 2007, compared to 40 and 24 states, respectively, in 



96 Puerto Rico provided student data by limited Spanish proficiency in place of limited English proficiency. Note that 
Spanish is the most commonly used language in Puerto Rico. 
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2005. State report cards in languages other than English, required to the extent practicable, were posted 
on the Web sites of seven states, the District of Columbia, and Puerto Rico. 97 

District-level report cards, conversely, remained difficult to find online. Through 2007, among the Web 
sites of the 25 largest school districts, ten included a direct link to the district report card on their home 
pages. Other district report cards required navigation through several layers of the Web site. As was 
true in 2005, nearly all district Web sites continued to include a link for parents in 2007, but in many 
cases, test results were not prominently displayed information. Overall, individual school reports were 
easier to locate than were district reports. From 2005 to 2007, an additional five districts made school 
reports (or profiles) accessible within one or two links, bringing the total to 23 out of the largest 25 
districts. Data over the last two years also suggest that districts are increasingly making their school 
report cards accessible to non-English speaking populations. As of 2007, 14 of these 25 school districts 
translated portions of their Web sites into other languages, most frequendy Spanish, but also Creole, 
Korean, French, Chinese, Portuguese, Vietnamese, Arabic, Urdu and Farsi. Links to translated Web 
pages were prominendy displayed. 

Although state and district report cards can be generally informative, parents are likely to be most 
interested in reports of their own child’s assessment performance. Under the “Parents Right-to-Know” 
section (Section 1111 (h) (6)) each district must provide the parents of students in Title I schools with 
“information on the level of achievement of the parent’s child on each of the State academic assessments 
required under this part.” These parent reports are often provided by a state assessment contractor. A 
review of a subsample of 25 parent reports indicated that they were often difficult to understand. 98 
While all states, the District of Columbia, and Puerto Rico reported student performance in terms of 
state proficiency levels (advanced, proficient, basic), four of those states indicated performance levels by 
a number without any associated word or phrase to help decode the meaning. Of the 21 states that did 
include proficiency level descriptions, a third were either very limited or laden with jargon. 99 For 
example, one state’s parent report card included text that was moderately difficult to understand: 

“High school students performing at the Proficient Level demonstrate a developed 
understanding of various genres. These students are able to draw and support 
conclusions using textual evidence. They identify, respond to, and evaluate problems or 
solutions. These students are able to recognize and evaluate a writer’s position within a 
text. They also differentiate among literal, connotative, and figurative meanings, and are 
able to make logical inferences. These students analyze information and interpret critical 
details. Proficient level students communicate and organize their ideas coherently, 
demonstrating what is relevant and accurate.” 

By comparison, a different state’s report described the overall “Meets Standards” student achievement 
designation for high school clearly and succinctly, yet lacking details: “Student work demonstrates 
proficient knowledge and skills in the subject. Students effectively apply knowledge and skills to solve 
problems.” 



97 Spanish versions of state report cards were made available in all seven states, the District of Columbia, and Puerto 
Rico. The District of Columbia also provided some additional documentation in Amharic, Chinese, French, and 
Vietnamese. 

98 The SSI-NCLB collected document data from a sample of 25 states, including interpretive guides and parent reports 
on student assessment results. These reports were evaluated by the SSI-NCLB research team using a rubric with 
categorizations, including use of graphics, explanation of proficiency levels, personalization of reports, and reading level. 

99 Parent reports were judged to include jargon when they used extensive quotations from the law, failed to explain legal 
terminology in lay terms, or otherwise used specialized language unlikely to be familiar to parents. 
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Overall, the reading level of the parent reports was above the eleventh-grade reading level, as measured 
by the Flesch-Kincaid readability test. However, there was a wide range among the states, from 4.5 in 
Texas to 14.6 in Minnesota and Mississippi. 

In terms of providing context for individual scores, ten reports did not include information comparing 
the student’s score to any other group — for example, other students in the state, district, or school. 
Twenty-one states included a graphic depiction of the child’s score within a full scale intended to help 
parents better understand the data. Twenty of these graphs were judged easy to comprehend and 
informative; 1 9 of the reports provided graphs that presented data not available within the text alone. 
Additionally, many states opted to personalize their parent reports, although to varying degrees. For 
instance, while 23 parent reports broke down the questions in each subject test (i.e., reading or 
mathematics) by their specific content standards, three states took this one step further by suggesting 
specific exercises the student could complete to improve performance in areas of weakness. Only one 
state, Florida, showed change over time, enabling parents to determine if their child was making 
progress. From an aesthetic standpoint, nine states employed color in their reports while six utilized 
illegible font size. 

States with additional accountability systems generally integrated the two systems 
in state report cards and press releases. 

Twenty-seven states had additional accountability systems. Of these, 15 states and the District of 
Columbia provided information from both systems together in the state report cards. In publicizing 
accountability results, 12 states issued press releases that discussed school performance in relation to 
both NCLB and the additional accountability systems. Four states provided separate press releases for 
results based on their additional accountability system and nine presented information on NCLB 
accountability only. 

Principal and Teacher Knowledge of the Status of Their Schools 

Nearly all principals knew whether their schools made AYP (90 percent) or were 
identified for improvement (94 percent). 

For NCLB accountability to have its desired effect, principals and teachers must be aware of their 
progress and status, not only overall but also of individual indicators and by subgroups. Most principals 
correctly reported whether their schools had made AYP and whether they were identified for 
improvement based on 2005—06 test results. Overall, 90 percent of principals were able to correctly 
report their schools’ AYP status in 2005—06, and 94 percent knew whether their schools had been 
identified for improvement for 2006—07 (see Exhibit 57). 100 

Among Title I schools, 95 percent of principals of non-identified schools correctly reported their 
school’s improvement status, compared with 87 percent of principals of schools identified for 
improvement (see Exhibit 58). For principals of identified Title I schools, this is an improvement over 
2004—05, when 78 percent incorrectly reported their school’s improvement status or reported that they 
did not know their school’s status. This improvement also represents a narrowing of the gap in school 
status awareness between principals of non-identified and identified schools, a difference of 8 percentage 



100 To compare principal and teacher knowledge regarding their schools’ status with the official designation obtained 
from the state department of education, NLS-IVCLB survey respondents in 2004—05 were asked whether their school 
made AYP in 2003—04, and whether, on the basis of those results, the school was identified for improvement for 
2004—05. This process was duplicated in 2006-07. 
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points in 2006—07 compared to 19 percentage points in 2004—05. Principals of schools that exited 
identification status during the period 2004—05 to 2006—07 were more likely to correctly report their 
status in 2006—07 than were principals of schools that entered identification status during this period 
(46 percent compared with 78 percent). 



Exhibit 57 

Percentage of School Staff Correctly Reporting Whether Their School Had Made AYP in 
2003-04 and 2005-06 or Was Identified for Improvement for 2004-05 and 2006-07 



Correctly Reported Made Adequate Yearly Correctly Reported School Was Identified for 

Progress Improvement 




Principals Elementary Secondary Special 
Teachers Teachers Education 
Teachers 



Principals Elementary Secondary Special 
Teachers Teachers Education 
Teachers 



Exhibit reads: Eighty-eight percent of principals correctly reported whether their school made AYP in 

2003— 04. Ninety-two percent of principals knew whether their school was identified for improvement for 

2004- 05. 

Note: Correctly reporting status indicates that the school status reported by staff (making AYP or not, identified for 
improvement or not) agrees with the official status of the school in the state records. 

Source: NLS-1VCLB, Principal and Teacher Surveys (« = 1,316 principals, 4,089 elementary teachers, 3,305 secondary 
teachers, and 1,191 special education teachers for 2004-05; n — 1,392 principals, 4,162 elementary teachers, 

3,483 secondary teachers, and 1,194 special education teachers for 2006-07; the surveys asked about AYP determination 
for the previous year). 



More teachers knew whether their schools made AYP or were identified for 
improvement in 2006 than in 2004 but remained less knowledgeable about their 
schools’ status than principals. 

Teachers, although increasingly alert to their schools’ status, lagged behind principals in terms of 
awareness. Between 63 and 73 percent of teachers correctly reported their schools’ AYP status in 

2005—06 compared with 90 percent of principals (see Exhibit 57). Similarly, between 57 and 66 of 
teachers correctly reported their schools’ improvement status in 2006—07 versus 94 percent of 
principals. 
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Secondary and special education teachers reported the largest increases in awareness of their schools’ 
accountability status. The percentage of secondary and special education teachers that correctly reported 
their schools’ AYP status increased by 5 and 6 percentage points, respectively, from 2004—05 to 2006— 
07. Likewise, the percent of secondary and special education teachers that knew whether their schools 
had been identified for improvement improved by 5 and 4 percentage points, respectively. However, 
secondary teachers remained less knowledgeable than special education and elementary teachers about 
their schools’ status. Based on 2005—06 data, 63 percent of secondary teachers correctly reported their 
schools’ AYP status, compared with 73 percent of elementary teachers and 71 percent of special 
education teachers. Similarly, 57 percent of secondary teachers correctly reported their schools’ 
improvement status, compared with 66 percent of elementary teachers and 64 percent of special 
education teachers. 

Among Title I schools, teachers in schools identified for improvement were more likely to be aware of 
the status of their schools than were teachers in non-identified schools. Between 64 and 76 percent of 
teachers in identified schools correctly reported their schools’ status, compared to 55 and 63 percent of 
teachers in non-identified schools (see Exhibit 58). 

Principal and teacher knowledge of school 
status did not appear to be related to the 
presence of an additional state 
accountability system. In 2005—06, 27 
states maintained accountability initiatives 
that went beyond the requirements of 
IVCLB, and some reports suggest that this 
situation might send mixed messages to 
stakeholders which could affect their 
understanding of their school’s 
identification status. However, the amount 
of disagreement between principals’ status 
reports and official school classifications 
was comparable in states in which NCLB 
was the only accountability initiative and in 
states in which a state accountability 
initiative was used in addition to NCLB 
(see Chapter III). 

Parents in a sample of eight large, urban 
school districts were much less likely to 
know whether their child’s school had been 
identified as low performing than were 
either principals or teachers. 101 Parents of 
students in identified schools remained 
largely uninformed of the improvement 
status of their child’s school. In 2006—07, 

1 9 percent of the parents of students in 

identified schools said their child’s school was on the state’s list of low-performing schools, 13 percent 



Exhibit 58 

Percentage of Staff in Title I Schools Correctly 
Reporting Whether Their Schools Were Identified 
for Improvement, 2006-07 

□ Non-identified Schools ■ Identified Schools 

. | 87% 

Principals 

Elementary 
Teachers 

Secondary 
Teachers 

Special Education 
Teachers 

0% 20% 40% 60% 80% 100% 




Exhibit reads: Eighty-seven percent of principals of 
identified Title I schools knew whether their schools were 
identified for improvement for 2006—07. 

Note: Correctly reporting status indicates that the school status 
reported by staff (making AYP or not, identified for 
improvement or not) agrees with the official status of the school 
in the state records. 

Source: NLS-IVCLB, Principal and Teacher Surveys (» = 1,083 
principals, 3,705 elementary school teachers, 2,216 secondary 
school teachers, and 928 special education teachers). 



101 The NLS-IVCLB surveyed a subsample of parents in nine districts regarding their experience with Title I school 
choice and supplemental educational services in 2004—05 and 2006-07. One district did not provide the data needed to 
draw a sample of parents. 
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incorrectly said their school was not on the list of low-performing schools, and 68 percent said they were 
not sure. Parents of children in non-identified schools were more likely to accurately report that their 
school was not on a list of low-performing schools (43 percent), while one-third (35 percent) were not 
sure. 

Discussion 

States continued to enhance their ability to produce and disseminate key ATCLB information about 
school performance to stakeholders. First, and as evidence of progress, only six states rendered 
preliminary determinations of schools identified for improvement after September for 2006—07 
compared to 19 for 2004—05. Second, by 2006—07, most state student data systems went beyond NCLB 
requirements, generating information to measure the progress of individual students. Forty-one states 
had data systems with unique student identifiers and the ability to match individual students’ test records 
from year to year. Third, most 2005—06 state report cards included achievement data disaggregated by 
student subgroups and district AYP performance and were straightforward to find online and to 
understand. Parallel to these advances in state communication on school performance, principals and 
teachers demonstrated greater awareness of their school AYP and identification status in 2006—07 than 
in 2004—05. Over 90 percent of principals and the majority of teachers knew whether their schools 
made AYP or were identified for improvement for 2006—07. 

Timeliness of final notification, although improved since 2004—05, remained a challenge for several 
states: nearly one-third of states finalized school improvement decisions in October 2006 or later. 
Reporting data on disaggregated graduation rates and teacher quality proved difficult as well. One-fourth 
of states did not report on the percentage of core academic area classes that were taught by non— highly 
qualified teachers; one-half did not report on disaggregated graduation rates. 
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VII. SCHOOL IMPROVEMENT 

NCLJ5 contains a number of provisions to encourage schools and districts to increase the achievement 
of students. This chapter describes improvement efforts with respect to schools, beginning with a 
discussion of state systems of support for schools identified for improvement and schools in corrective 
action and restructuring. Following that, the chapter contains information about schools’ technical 
assistance needs and services received, schools’ own improvement efforts, and required interventions for 
identified schools. Data on improvement efforts for districts are presented in the next chapter. These 
two chapters describe the type and amount of services provided to schools and districts, but generally we 
do not have information about the quality of the services described. 



Key Findings 

• By 2006—07, all states established systems of support for school improvement; most 
reported providing some level of support to all identified schools. Others targeted 
support to a subset of identified schools. Support teams were the most common 
mechanism for delivering support to schools identified for improvement in 2006—07, and 
were used in 42 states, the District of Columbia, and Puerto Rico. 

• In 2006—07, 40 states had tiered systems of support, compared to 18 in 2004—05. All 

states focused on diagnostic aspects of the school improvement process: data analysis and 
developing a school improvement plan. Fewer states provided sustained assistance through 
implementation of improvement strategies. 

• Both identified and non-identified schools reported needing and receiving technical 
assistance in many areas in 2006—07, but the need was greater among identified 
schools. In most areas, principals reported that the technical assistance received met their 
needs. Flowever, one-third of the schools that needed technical assistance to improve 
services to students with disabilities, and one-half of schools needing technical assistance to 
improve services for limited English proficient students, did not have their needs met. 

• Improving curriculum and instruction was a major focus of school improvement in 
2006—07 in both identified and non-identified schools, and almost all teachers had 
access to materials to align curriculum with standards. In addition, almost all teachers 
reported using state test results to improve student learning, and about two-thirds of schools 
reported using periodic progress assessments as well. 

• Almost three-quarters of schools offered extended-time instructional programs in 
2006—07, which served a small but increasing percentage of students. Identified 
schools were more likely to offer extended time programs than non-identified schools. On 
average, third-grade students spent about 20 minutes more in reading and about 10 minutes 
more in mathematics in 2006—07 than in 2004—05, although time devoted to other subjects 
was virtually unchanged. At the secondary level, about one-half of schools reported 
increasing instructional time in reading and mathematics for low- achieving students from 
2004-05 to 2006-07. 

• In 2006—07, required interventions occurred in most Title I schools in year 1 or year 2 
of identification or in corrective action. However, many Title I schools in restructuring 
did not experience any of the specific interventions listed in the law. 
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State Support for School Improvement 



NCLB requires states to develop systems of support for Title I schools that have been identified for 
improvement, corrective action, or restructuring. We first describe state systems in general and the 
support provided for identified schools, and then we describe state strategies for working with schools in 
corrective action and restructuring. State support for districts is described in the next chapter. 

State efforts to support struggling schools are not unique to NCLB; indeed, by 1999—2000, at least 
20 states described strategies to assist schools that were identified for improvement under L4SA (Goertz 
and Duffy, 2001). However, NCLB codified specific requirements for states: Section 1117(a)(4) 
specifies that these systems of support are to include the following approaches: 

• Establishing school support teams for assignment to schools identified for improvement; 

• Designating and using distinguished teachers and principals who are chosen from schools that 
have been especially successful in improving academic achievement; 

• Devising additional approaches to providing assistance, such as providing assistance through 
institutions of higher education, education service agencies, and private providers of scientifically 
based technical assistance. 

Under NCLB, state support systems have become more comprehensive and more complex, including 
multiple support structures and layers of support that are designed to provide more intense assistance for 
schools and districts that face the most substantive challenges. Although states vary in the architecture 
of their support systems, they share some common elements. 

The most common mechanisms of state support are those that also existed prior to NCLB, and are 
outlined in the law: support teams and distinguished educators. In 2006—07, 42 states, the District of 
Columbia, and Puerto Rico reported using support teams and 26 states reported using distinguished 
principals and teachers as either a primary support mechanism or as an important component of their 
support system. Other mechanisms of support included regional centers as well as outside consultant 
groups to outsource some or all of the support to schools and districts. Notably, many states provided 
differentiated support through “tiered systems.” In tiered systems, the intensity of support and the 
mechanisms through which the state provided support varied by the number of years a school or district 
had been identified for improvement or the subgroups for which schools or districts did not make AYP. 

State systems of support for schools identified for improvement 

By 2006-07, all states had established systems of support for school improvement; 
most reported providing some level of support to all schools identified for 
improvement. Others targeted support to a subset of identified schools. 

In 2006—07, 43 states, the District of Columbia, and Puerto Rico reported that they provided or offered 
some level of support to all Title I schools identified for improvement during the 2006—07 school year. 102 
Thirty-six states, the District of Columbia, and Puerto Rico provided support to both Title I and non— 
Title I schools that were identified for improvement, and of those, 30 states, the District of Columbia, 
and Puerto Rico provided support to all Title I and non— Title I identified for improvement. Nine states 



102 The description of state systems of support in the following sections are not intended to imply compliance under 
NCLB. 
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indicated that they prioritized schools in the later stages of improvement and provided more intensive 
support to these schools. 

The most common support mechanisms used by states were two of those mandated by NCUi: school 
support teams and distinguished teachers or principals. Most states identified one of five common 
approaches as the primary mechanism used to support schools in the state (see Exhibit 59), with many 
states using more than one mechanism. In 2006—07, 14 states and the District of Columbia reported that 
support teams were the primary form of support; in 14 other states, school improvement specialists were 
the primary form of support. Decentralized structures, such as regional centers or county offices, were 
the primary support mechanisms in eight states and Puerto Rico. In five states, support was relatively 
limited, consisting of statewide meetings or simply the provision of information about available 
resources and grants. These states convened statewide meetings for identified schools to review NCUi 
accountability requirements, discuss improvement strategies, provide feedback on the development of a 
school improvement plan, offer advice to facilitate the school improvement process, and ensure 
appropriate disbursement of improvement funds. In 2006—07, seven states reported that districts were 
the primary source of support for identified schools, and the state assumed a very minimal role in school 
support. 



In 2006-07, states were more 
to delegate responsibility 
for supporting schools to 
districts than in 2004-05. 



States’ approaches to supporting schools 
identified for improvement changed 
between 2004—05 and 2006—07. In 
2006-07, states were more likely to 
delegate the responsibility for supporting 
schools to other levels of government 
(e.g., county, regional entities, districts), 
with a particular emphasis on districts 
providing support to schools. (Districts’ 
reports of their technical assistance 
efforts are described on page 131). At the 
same time, states were less reliant upon 
school support teams as the primary 
mechanism of support to schools 
identified for improvement. In many states, regional authorities are a significant resource: For example, 
the Wayne County Regional Educational Service Agency (RESA), which includes Detroit, Mich., has 
more employees than the Michigan Department of Education. 

In 2006-07, 40 states had tiered systems of support, compared to 18 in 2004-05. 

An increasing number of states reported having tiered systems of support for schools, in which the 
intensity and focus of support varied as schools progressed to more severe accountability levels. In 
2004—05, 18 states reported having such systems. In 2006—07, 38 states, the District of Columbia, and 
Puerto Rico reported having a tiered system in which the level of support was determined by the number 
of years a school had not made AYP, a school’s Title I status, or supplementary accountability measures, 
such as a state accountability index. Most of the states with tiered systems of support used the number 




Exhibit 59 

Number of States, by Primary Mechanisms of 
Support, 2006-07 




Exhibit reads: In 2006—07, 14 states reported the primary 
mechanism of support was improvement specialists and 
1 5 states reported the primary mechanism of support was 
support teams. 

Sources: SSI-NCLB, Accountability Interviews 2006-07 and 
analysis of state documents (« = 50 states, the District of 
Columbia, and Puerto Rico). 
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of years a school had been identified for improvement to gauge the intensity of support. Four states 
prioritized Tide I schools before supporting non— Title I schools and eight states reported providing 
different types of support to Title I and non-Title I schools. 

For example, Georgia developed a continuum of services consisting of nine levels of “Needs 
Improvement” (NI) through which schools receive progressively more intense services. In Nil and 
NI2, a school improvement leadership facilitator visits the school three times each nine weeks 
throughout the school year, in addition to assistance provided through the Regional School 
Improvement Core Team and staff training on the Georgia Learning Frameworks. For schools in 
NI3— 4, visits from the leadership facilitator increase to once a week; by NI5 the facilitator is on site 
twice a week, and the school is required to implement an improvement contract that is signed by the 
Georgia state school superintendent and monitored by the state education agency. In addition, the 
amount of school improvement funds for which schools are eligible increases each year that a school is 
identified for improvement. 

Likewise, Nevada reported that, while all schools have access to an improvement planning tool available 
online, schools that are identified for improvement for one, two or three years receive the assistance of 
an external school facilitator. Subsequently, schools that continue to be identified for improvement 
(restructuring) receive support from a school support team comprised of a team leader, a district level 
administrator, a principal from an effective school, a teacher from an effective school, and a parent. The 
support team spends concentrated time with these schools through the entire school year. The decisions 
made by the school support team supersede those of the district. 

State Use of Support Teams 

Support teams were the most common mechanism for delivering support to schools 
identified for improvement in 2006-07, and were used in 42 states, the District of 
Columbia, and Puerto Rico. 

Under NCLB, school support teams are to include highly qualified or distinguished teachers and 
principals, pupil services personnel, parents, representatives of institutions of higher education, 
representatives of outside consultant groups, representatives of regional education laboratories or 
comprehensive regional technical assistance centers, or other individuals deemed appropriate by the 
state. State officials reported that the composition of support teams varied widely but generally 
consisted of education officials or consultants with expertise in areas such as Title I, curriculum and 
instruction, data analysis, special needs populations, and implementation of improvement strategies in 
low-performing schools. Team members came from a range of backgrounds and organizations, 
including the state education agency, regional or county offices, consultant groups or individual experts, 
high-performing schools, and networks of retired educators and administrators. During 2006—07, 

42 states, the District of Columbia, and Puerto Rico provided support to identified schools through 
some type of support team. Additionally, two states reported that they were piloting support teams in 
2006—07 and another state planned to implement support teams in 2007—08. Fourteen states and the 
District of Columbia relied on support teams as a primary mechanism of support. 

Support teams shared the feature of being external to the school, potentially affording a new perspective 
on strategies for school improvement. However, they varied in a number of ways, including the 
organizations from which they originated, their role in the improvement process, the target of their 
support, and the schools or districts to which they provided support. In 2006—07, school support teams 
originated at the state level in 21 of the 42 states that reported using them. That is, the teams consisted 
of individuals who were employed by the state education agency or served as consultants. Many states 
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drew support team members from various departments within the state education agency, bringing 
complementary perspectives to the challenges of school improvement. In 17 states, support teams were 
developed and operated by regional education organizations; in four states, the teams were the 
responsibility of districts. In the case of regional systems, the regional units were still under the purview 
of the state education agency and part of an overall “state system” even if the staff was focused on only 
one region of the state. District teams were mandated by the state, which often oversaw their training 
and appropriate assignment to schools and provided supplementary personnel if there was not adequate 
staffing at the district level. Nine states reported hiring consultants either to supplement expertise on 
support teams or to comprise the entire support team. 

As a mechanism of support, support teams are ultimately aimed at stimulating improvement in identified 
schools; however, the support was not always targeted solely at schools. In 27 states, the District of 
Columbia, and Puerto Rico, support teams worked directly with schools, but in 15 states, support teams 
worked with districts, which in turn were expected to work with schools identified for improvement. In 
11 of the states in which support teams worked with districts, the teams were deployed when schools 
within the district were identified for improvement. Moreover, states often targeted their support to 
specific types of identified schools — in 20 states, support teams worked with a subset of schools or 
districts identified for improvement, prioritizing schools based on the number of years identified for 
improvement. 

The number of support teams in each state varied greatly. In 2006—07, seven states reported having one 
support team based at the state level. For example, in Wisconsin, there is one large support team, from 
which individuals are selected and deployed to schools identified for improvement based on particular 
needs of the schools. Other states reported having as many as 50 support teams. 

Likewise, the intensity of support provided by these teams varied across and within states. While seven 
states reported that support teams were on-site at least weekly, officials in nine states reported that 
support teams visited identified schools fewer than ten days each year. In some cases, less intense 
activity on the part of teams may be part of the design of a tiered state system of support. For example, 
in Michigan, audit teams are on site just twice a year, and mentor teams visit identified schools eight 
times each year. But when schools reach higher levels of the accountability system, they receive services 
from principal mentors who provide 1 00 days of support. 

State Use of “School Improvement Specialists” to Provide Support 

In 2006-07, 26 states engaged school improvement specialists to assist schools 
identified for improvement. 

Individuals who provide support for school improvement did not lend themselves to simple 
categorizations: across different states, they were called school improvement specialists, principal 
mentors, exemplary educators or coaches. Few states, in fact, used the NCUi terminology of 
distinguished principals and distinguished teachers, and few defined the role of these individuals in a 
manner strictly aligned with IVCLB. Many states relied on retired teachers and school administrators; 
some states selected individuals from other fields if these individuals had appropriate expertise (for 
example, financial expertise). Of the 26 states that engaged school improvement specialists in 2006—07, 
19 reported that at least some of the time they contracted with consultants to provide this support to 
schools identified for improvement. Many states used school improvement specialists to participate in 
other support mechanisms. For example, California identified skilled educators (whether currently in the 
classroom or retired) with appropriate expertise to participate on support teams. Nineteen states 
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reported that specialized individuals worked with both Title I and non— Tide I schools that were 
identified for improvement in 2006—07. 

In 1 8 states, school improvement specialists supported data analysis and improvement planning in 
2006-07. Additionally, nine states reported that specialized individuals provided needs-based support 
to schools and to districts (which may include support throughout the implementation of a school 
improvement plan) and seven states reported that specialized support was content focused — that is, 
with an explicit focus on reading or mathematics. In Alabama, for instance, school improvement 
specialists were part of a tiered system of support provided to schools. The role of these specialists was 
to guide school-level teams not only in analysis and planning but also to support school leadership in 
monitoring implementation, continuously improving plans and studying and sharing the craft of 
successful teaching. 

Alaska developed a different model for using improvement specialists. Alaska’s mentor program was 
designed to support both teachers and principals in ways that foster and sustain school improvement. 
The teachers and principals that were selected for the Alaska Statewide Mentor Project (ASMP) went 
through a rigorous application and selection process conducted by the Commissioner of Education, 
Deputy Commissioner, and ASMP Project Directors. Many of those who were selected to mentor and 
coach were recognized by their home district or at the state level for their expertise and service. In 
2006—07, the third full year of implementation of the ASMP, Alaska had 27 teacher mentors serving 
400 beginning teachers and 9 principal coaches serving 85 principals across the state. The principal 
coaches worked specifically on leadership skills, using data to make instructional decisions and changes 
in the classroom, implementing formative assessments in the school, and identifying effective 
instructional practices. 

Content of Support Provided by States 

In 2006-07, all states focused on providing assistance on diagnostic aspects of the 
school improvement process: Data analysis and development of school 
improvement plans. Fewer states provided sustained assistance through 
implementation of improvement strategies. 

In about half of the states, the emphasis of support was primarily diagnostic: in 28 states, the providers 
of support assist in the analysis and planning process, leaving the implementation and monitoring of the 
improvement strategies to local officials. In contrast, 22 states, the District of Columbia, and 
Puerto Rico had designed state systems of support intended to go beyond diagnostic interventions into 
support for implementation. Alaska and Alabama (described above) had two such systems; another state 
was Vermont where the improvement specialist acted as a coordinator who facilitated improvement 
throughout the implementation process. The coordinators worked with identified schools to develop 
required actions for improvement and to ensure that Title I improvement funds supported these actions 
for school improvement. Additionally, the coordinator worked to identify additional resources and was 
the main contact for all providers working with the school identified for improvement. 
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In 2006—07, the type of support 
most frequently provided by 
states was assistance with data 
analysis (47 states, the District of 
Columbia, and Puerto Rico) 103 . 

Nearly as many states (44 states, 
the District of Columbia, and 
Puerto Rico) described their 
support as “needs-based” 

(see Exhibit 60). Indeed, the 
focus of school support was 
often determined by the 
situational factors of a particular 
school. For example, in 
2006—07, Idaho used a three- 
tiered model that relied on an 
online tool for schools identified 
for improvement and for 
districts with schools identified 
for improvement. The tool 
provided information to schools 
and districts by matching local 
needs to supports offered by the state. Within this system, for example, if a school did not make AYP 
because of insufficient scores of students with disabilities, it was referred for intensive Response to 
Intervention training. Similarly, a Michigan state official explained that their special education division used 
a state grant to develop an extensive support program “that is specifically designed for schools that have 
missed AYP strictly on the basis of the achievement of students with disabilities.” 

In 2006—07, 14 states described their support role as that of a resource broker — they ensured that the 
schools were informed of and had access to the improvement funds and grants competitions for which 
they were eligible. Eighteen states focused at least some support on a content area, such as literacy or 
mathematics. This represents an increase from 2004—05, when only five states provided support with an 
explicit content focus. 

Comprehensiveness of State Support 



Exhibit 60 

Number of States, by Focus of Support They Provided, 

2006-07 
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Exhibit reads: In 2006—07, 49 states reported that at least part of 
their support to schools was focused on data analysis. 

Sources: SSl-NCLB, Accountability Interviews, 2006-07 and state policy 
documents (» = 50 states, the District of Columbia, and Puerto Rico). 



Support systems were judged to be comprehensive in 25 states, moderate in 
22 states, and limited in five states. 



Some states were engaged in multiyear efforts to develop comprehensive systems that supported schools 
at various levels of improvement. To capture this variation, the SSI-IVCLB research team classified state 
systems of support into three levels — comprehensive, moderate, and limited — based on the breadth of 
the support structures, the proportion of identified schools that received support, the background and 
training required of individuals who provided support, the presence of complementary layers of support, 
and the existence of a statewide research-based improvement process (such as the SAGE process in 



103 The remaining three states that reported providing “needs-based” support to schools identified for improvement may 
implicitly use data analysis and improvement planning to identify needs; however, based on the data collected, this was 
difficult to determine. 
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Nevada or Michigan’s school improvement framework). 104 The states with comprehensive systems 
provided direct assistance to schools, procedural steps that articulated and defined the improvement 
process, and tools to engage and inform schools as they considered improvement options. Although 
some systems of support may be judged to be more “comprehensive” than others, this does not imply 
that they have proven more effective in improving students’ academic achievement. Many of the states 
with moderate or limited systems were building their systems and working to incorporate stmctures that 
were more consistent with the NCU3 requirements (e.g., they added school support teams or 
distinguished teachers to their support systems). However, some states provided only minimal support, 
limited to a few voluntary statewide meetings or the provision of information to districts and schools 
about federal grants that might stimulate improvement. From 2004—05 to 2006—07, the number of states 
with comprehensive systems of support increased, while the number of states with limited systems of 
support decreased (see Exhibit 61). 



Exhibit 61 

Number of States, by Extent of Comprehensiveness of 
Their Systems of Support for Schools, 2004-05 and 2006-07 



■ 2004-05 

□ 2006-07 25 




Limited Moderate Comprehensive 

Extent of Comprehensiveness of State Support 

Exhibit reads: In 2004—05, nine states had limited systems of support for schools, compared 
to five states in 2006-07. 

Sources: SSI-NCLB, Accountability Interviews 2006-07 and state policy documents (« = 50 states, the 
District of Columbia, and Puerto Rico). 



Overall, states with comprehensive systems of support for their low-performing schools tended to be the 
states with higher concentrations of schools identified for improvement. For example, 12 percent of 
schools in states with comprehensive systems of support were in the first year of improvement, whereas 
only 5 percent of schools in states with limited systems were in the first year of improvement. It may be 
that states with high proportions of schools identified for improvement were also most likely to perceive 
an acute need to develop support systems. Also, states with fewer schools identified for improvement 
may have faced fewer capacity challenges, and were able to provide support to all identified schools 
through a simpler model. 



104 These classifications do not necessarily reflect statutory requirements but are intended to reflect the variation in state 
implementation of systems of support for schools identified for improvement. 
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Strategies to Expand State Capacity for Supporting Schools 



States reported challenges associated with increases— or anticipated increases— in 
the number of schools identified for improvement. 

State officials frequently expressed concern about their capacity to provide continued support to the 
increasing number of schools being identified for improvement and the growing number of schools 
moving into corrective action and restructuring. One official elaborated: 

“This year as we’ve had growing numbers of schools to review and a growing number of 
schools and districts that are in the more extreme status, corrective action and 
restructuring. . .we’ve had to use more funds to purchase third party services to provide 
more intensive support in those schools and districts, leaving less money for what I’ll call 
the more ‘preventive medicine’ side of the work which is . . . being there onsite to help a 
school that’s identified for improvement before it gets to corrective action and 
restructuring.” 

The anticipation of growing numbers of schools being identified for improvement led states to identify 
ways to expand capacity for improvement within the constraints of available resources. States attempted 
to strike this balance through measures focused on 1) providing differentiated support to schools of 
higher priority, or 2) expanding capacity within other levels of the educational system. 

As noted earlier, in 2006—07, 38 states, the District of Columbia, and Puerto Rico reported having tiered 
systems of support that provided differentiated levels of support to schools based on the severity of their 
accountability designation. Such systems enabled states to focus the most intense assistance — and 
hence, more resources — on the schools that needed it most, while assuring at least a minimal level of 
support for other identified schools. 

In addition, some states shifted their support to districts and counties in order to expand capacity for 
improvement. Indeed, in 2006—07, 28 states indicated that they intended to build district capacity to 
better support schools identified for improvement. For example, in Louisiana, the state trains 
individuals in each district to be members of Districts Assistance Teams (DATs) that are responsible for 
working with schools identified for improvement. In Tennessee, state officials changed the structure of 
the support system after 2004—05: previously, the support system bypassed the district, but state officials 
concluded that they were not building adequate capacity at the local level. Following modifications to 
the statewide system of support, district officials play a more integral role, particularly through the 
Tennessee Comprehensive Planning Process. 

As of 2006—07, another 23 states and Puerto Rico opted to build in a secondary layer of support 
provided by using the existing infrastructure of regional centers, area education agencies, or county-level 
offices. In Maine, for example, the state employed an external consultant as an improvement specialist 
to work with schools, and this specialist is responsible for coordinating a team from the region to 
support schools identified for improvement based on their needs. In Oregon, the state worked with 
Title I schools identified for improvement, but support for non— Title I schools identified for 
improvement comes from the regional Education Service Districts. The secondary layer allowed for 
states to either supplement or enhance support for schools identified for improvement. 

Finally, in 2006—07, 32 states used outside consultants or organizations to complement their statewide 
system of support. For example, Arkansas relied on the organization America’s Choice to implement its 
comprehensive school reform model and Utah reported using consultants to supplement the available 
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expertise on individual support teams. Another two states reported using outside consultants to train 
members of their support teams or their improvement specialists. As one state official commented, 

“You can’t have enough staff to deal with these situations. It comes down to outside consultants.” 

State Strategies for Schools in Corrective Action and Restructuring 

As reported in Chapter IV, the number of states with schools in corrective action and restructuring 
status increased from 2004—05 to 2006—07. In 2004—05, 37 states had schools in corrective action, which 
increased to 48 states, the District of Columbia, and Puerto Rico in 2006—07. Likewise, 29 states had 
schools in restructuring in 2004—05, which increased to 43 states, the District of Columbia, and 
Puerto Rico in 2006—07. 

The most popular state corrective action strategy in 2006-07 was implementation of 
a new curriculum, as it had been in 2004-05. However, states were more likely to 
replace all or most of the school staff as a restructuring strategy in 2006-07 than in 
2004-05. 

As expected, the number of states that reported using specific corrective action and restructuring 
strategies increased from 2004—05 to 2006—07. However, in 2006—07, as in 2004—05, implementation of 
a new curriculum was the most frequently reported approach to corrective action, followed by 
appointment of an outside advisor. There was a notable increase in the number of states that decreased 
the management authority of the school, from 17 to 31 states (see Exhibit 62). 

With regard to restructuring, the most frequently cited option, again, was “other major restructuring of 
school governance.” States reported that this included activities such as implementing a new curricular 
program, providing instructional coaching, establishing a school improvement council, implementing a 
comprehensive school reform model, offering merit pay to retain exemplary staff, or reconfiguring the 
school day or school year. One state reported dissolving old schools and opening new schools with 
different grade spans. 

Some corrective action and restructuring strategies were excluded by state laws. In 15 states, the state 
education agency was prohibited from taking over schools. Other options for which states faced legal 
barriers included entering into a contract with a private entity (prohibited in eight states), replacing 
school staff (prohibited in seven states), and reopening the school as a public charter school (prohibited 
in seven states). Even in states that had no legal barriers to state takeover of schools, state officials were 
reluctant to do so. As one state official explained, “Takeover of the school by the state has not been 
used in any way shape or fashion. There is no plan to do that in the state. There is nothing in state law 
that would prohibit [taking over the school] but there really is no mechanism to enable [the state to take 
over the school].” An official from a different state explained that they had tried school takeover but did 
not find it effective, while another state official commented that they lacked adequate capacity at the 
state level. Likewise, some states had no legal prohibitions against replacing staff, but said this action 
could prove difficult because of collective bargaining agreements or union presence. 
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Exhibit 62 

Number of States Using Specific Corrective Action and Restructuring Strategies, 

2004-05 and 2006-07 


Strategies 


2004-05 


2006-07 


Corrective Action Strategies 


{n = 37) 


(n = 50) a 


Replacement of staff relevant to failure to make AYP 


20 


33 


Implementation of a new curriculum 


35 a 


42 


Significant decrease in management authority at the school 


17 


31 


Appointment of an outside advisor 


29 a 


40 


Extension of the school year or school day 


26 


32 


Restructuring the internal organization of the school 


23 


33 


Restructuring Strategies 


(n = 29) 


(n = 45) a 


Reopening the school as a public charter school 


4 


12 


Replacing all or most of the school staff 


9 


23 


Hiring a private management contractor 


7 


8 


State takeover of a school 


2 


2° 


Other major restructuring of school governance 


18 


29 


Exhibit reads: Twenty states reported replacing school staff relevant to the failure to make AYP as an 
intervention for schools in corrective action status. 


Note: The number of states includes all states with schools in corrective action and restructuring who 
this survey question. 

a Indicates that the District of Columbia, and Puerto Rico are included. 


responded to 


b Note that state takeovers are authorized through Louisiana’s accountability mechanisms that pre-date NCLJi. 
Hence, while the state has taken over schools, it is not exclusively in the context of NCLJi accountability. 


Source: SSI-NCLB, Accountability Interviews. 









When selecting corrective actions, “the districts are in the driver’s seat.” However, 
states played an active role in determining restructuring strategies. 

In the majority of states with schools in corrective action (30 states and the District of Columbia), the 
corrective actions for specific schools were determined at the district level. In the remaining states, the 
state education agency either collaborated with the district to select options, or made the determination 
entirely at the state level. In many cases of collaboration, the district conducted the needs assessment 
and made initial recommendations, which were then approved by the state education agency. In some 
cases, the selection of corrective action strategies was fairly prescribed — in Hawaii, the state developed a 
Framework for School Improvement, which is a system of support as well as consequences. As schools 
move from one level of accountability to the next, both support and the required consequences change. 
Arkansas employed one primary intervention — all schools in corrective action or restructuring were 
encouraged to participate in the America’s Choice comprehensive school reform model. In other states, 
the determination of consequences was less structured. For example, in Indiana, optional corrective 
actions included “an open discussion [between the state and] the superintendent.” 

By the time a school reached restructuring status, the state played a more active role. The majority of 
states with schools in restructuring status were involved in both the restructuring planning process and 
the restructuring implementation process (28 states, the District of Columbia, and Puerto Rico). A 
Massachusetts state official explained, “When we take a school into corrective action or restructuring 
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status, they become a Commonwealth priority school. . . the state board of education ultimately can 
direct for any school that’s in restructuring.” However, there were some exceptions to this general 
pattern: In North Carolina, for instance, the state opted to focus on schools in corrective action, rather 
than restructuring, in an effort to prevent them from entering the more severe improvement status. In 
addition, even when states were more active in the restructuring stage, districts were still involved — in 
21 states with schools in restructuring, the local education agency played an active role in planning and 
implementing improvement strategies. Other organizations that participated in this process included 
school support teams (10 states), regional agencies (six states), and school improvement specialists (seven 
states). In Montana, the National American Indian School Boards Association was involved with the 
restructuring process, because 90 percent of Montana schools in restructuring are Indian schools. 

While states must ensure that schools implement interventions in accordance with NCLB, they have a 
more pressing concern: identifying strategies that will ensure that schools with a persistent pattern of low 
performance improve. As one state official commented, “we need real-world examples of what’s 
working.” Examples from two states are illustrative of the strategies states are undertaking to reach the 
most challenging schools. 

Virginia’s Turnaround Specialist Program, a partnership between the business and education schools at 
the University of Virginia, has been receiving attention within and outside of the state. The program is 
described as “an executive education program specifically designed for the needs of a cadre of experts 
who are charged with turning around consistently low-performing schools in the commonwealth.” 105 
The training focuses on leadership challenges, strategic change, data-based decision-making, 
communications, conflict-management, sustaining transformations, and leveraging resources. The 
performance-based Turnaround Leadership Credential is awarded at the end of the two-year program 
after the turnaround has occurred and there is satisfactory evidence of sustained improvements. 
Participants are placed in schools in corrective action, and are expected to ensure that at the end of two 
years of training, the Turnaround Specialist’s school has made AYP. 

Similarly, North Carolina launched its High School Turnaround during the 2005—06 school year. This 
initiative is designed to address the special needs of high schools that are identified as low performing 
because of the large number of students performing below proficient or because of a history of below- 
average performance. Based on each school’s “Framework for Action,” each receives support from 
trained leadership facilitators, customized professional development for principals, and professional 
development for teachers. In addition, each school is required to adopt a reform model, either 
America’s Choice, the New Schools Project, or Talent Development High Schools. In order to sustain 
improvement efforts, district offices are expected to work closely with each participating school. 

Twenty-two states and Puerto Rico reported that at least one school had exited 
restructuring status since NCLB ms enacted. 

Officials from 15 states reported that schools were able to improve performance and therefore exit 
restructuring status because of a substantive change in school practices, such as new leadership, 
instruction that was more closely aligned to standards, or a schoolwide focus. As one state official 
explained: “the staff and faculty at the school came together.” Among these 15 states, others attributed 
the improved performance to the presence of a school support team or exemplary educators. In 
two states, officials noted that some schools in restructuring had been so identified for a specific 
subgroup, and when the school and district deployed resources to target this group, the schools were 



105 Virginia State Department of Education, http:/ /www.doe.virginia.gov/VDOE/Instruction/ OCP/vstsp.html 
(accessed February 2008). 
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able to raise achievement levels. However, state officials in three states reported that schools exited 
restructuring status because they had closed, were consolidated, or were annexed by other schools. By 
contrast, nearly half of the states with schools in restructuring (21 states and the District of Columbia), 
reported that no schools within this group had ever exited restructuring status. 

Technical Assistance for Schools 

NCLB contains specific requirements regarding the provision of technical assistance to identified 
schools, assigning responsibility to both states and districts for providing assistance to schools in a 
variety of areas. 106 States and districts were free to provide the required assistance themselves or to 
contract with other organizations, such as regional offices, nonprofit organizations, or individual 
consultants, to provide some or all of the technical assistance to schools. As a result, schools did not 
always know the ultimate source of the technical assistance they received. States and districts reported 
on the types of technical assistance they provided but not the location or number of schools that 
received each type of assistance. Hence, we cannot directly connect state, district, and principal reports. 
In addition, schools were often motivated to undertake their own improvement efforts, which could 
include seeking assistance from outside providers. 

Schools’ technical assistance needs 

Principal survey results confirmed that schools had broad needs for technical assistance, that a wide 
range of technical assistance was provided, and that most assistance met schools’ needs. Principals 
indicated whether or not they needed assistance in 13 areas that are commonly the focus of school 
support efforts. If such assistance was needed, principals indicated whether or not it was received, and if 
received, whether or not it was sufficient to meet their needs. 

Both identified and non-identified schools reported the need for technical 
assistance in many areas, but the need was greater among identified schools. 

Principals indicated whether they needed technical assistance in 13 areas that are commonly emphasized 
in such programs. They also indicated whether such assistance was received, and if so, whether it met 
their needs. Most principals reported that their school needed technical assistance related to some area of 
NCLB implementation in either 2005—06 or 2006—07 (see Exhibit 63). 107 For example, more than 
one-half of all schools reported needing assistance to improve the quality of teachers’ professional 
development but only about one-quarter reported needing assistance with school improvement planning. 
This is consistent with the emphasis states have placed on support for school improvement planning 
reported above. 

Principals in identified schools were more likely to report needing assistance than were principals of 
non-identified schools in each of 13 areas surveyed. For example, 77 percent of identified schools 
reported needing technical assistance to identify effective curricula, instructional strategies or school 
reform models, compared with 47 percent of non-identified schools. On average, schools in Year 1 or 
Year 2 of identification reported that they needed assistance in eight of the 13 areas, compared with five 
areas for non-identified schools. The number of areas of need is an imperfect measure because it does 



106 NCLB does not require specific types of technical assistance, although it does require that priority be given to schools 
identified for improvement for the greatest number of years. 

107 To obtain more complete information, respondents were asked about technical assistance during “the last school year 
(2005—06, including the summer of 2006) or the present school year (2006—07).” All results reflect this time period. 
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not capture the intensity of a school’s need for assistance; one school might have acute needs in one or 
two areas while another might have limited needs in several areas. 



Exhibit 63 

Percentage of Non-ldentified and Identified Schools That Reported Needing and 
Receiving Various Types of Technical Assistance, 2005-06 or 2006-07 


Type of Technical Assistance 


Percent of 
Non-ldentified 
Schools That 
Needed 
Assistance 
(n = 918) 


Percent of 
Identified 
Schools That 
Needed 
Assistance 
(n = 469) 


Percent of 
Identified Schools 
Needing 
Assistance That 
Received It 
(n = 292) 


Percent of Identified 
Schools Reporting That 
Assistance Received 
When Needed Was 
Sufficient 
(n = 243) 


Improve quality of teachers’ professional 
development 


53% 


77% a 


82% 


73% 


Get parents more engaged in their child's 
education 


46% 


72% a 


52% 


65% 


Address instructional needs of students with 
individualized educational programs (lEPs) 


51% 


69% a 


68% 


76% 


Identify effective curricula, instructional 
strategies, or school reform models 


48% 


77% a 


84% 


82% 


Improve students’ test-taking skills 


29% 


63% a 


61% 


86% 


Analyze assessment results to understand 
students’ strengths and weaknesses 


41% 


62% a 


93% 


81% 


Identify or develop detailed curriculum 
guides, frameworks, pacing sequences, 
and/or model lessons aligned with state 
standards 


43% 


68% a 


79% 


83% 


Develop or revise school improvement plan 


26% 


55% a 


91% 


89% 


Recruit, retain, or assign teachers in order to 
staff all classes with a teacher who is highly 
qualified 


30% 


56% a 


71% 


75% 


Address problems of student truancy, 
tardiness, and discipline, and of dropouts 


40% 


60% a 


68% 


61% 


Implement the provisions of NCLB relating to 
qualified paraprofessionals 


26% 


52% a 


82% 


95% 


Address instructional needs of LEP students 


33% 


45% a 


74% 


70% 


Analyze and revise school budgets to 
allocate resources more effectively 


27% 


50% a 


66% 


84% 


Exhibit reads: Fifty-three percent of schools not identified for improvement reported needing technical 
assistance to improve the quality of teachers’ professional development in 2005—06 or 2006—07. 
a Indicates statistically significant difference between identified and non-identified schools (p<.05). 

Source: NLS-IVCLB, Principal Survey. 
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In addition, the need for technical assistance was greater among those categories of schools that were 
more likely to be identified for improvement. For example, a greater percentage of high-poverty and 
high-minority schools reported a need for four selected types of technical assistance than schools with 
low concentrations of such students (see Exhibit 64). 





Exhibit 64 






Percentage of Schools Needing Technical Assistance in Four Areas, 


by School Characteristic, 2005-06 or 2006-07 






Develop or 
Revise the 
School’s 


Analyze Assessment 
Results to 
Understand 


Get Parents 
Engaged in 
Their 


Improve the 
Quality of 
Teachers’ 


School Characteristic 


Improvement 

Plan 


Students’ Strengths 
and Weaknesses 


Child’s 

Education 


Professional 

Development 


All Schools (n = 1,392) 


30% 


44% 


49% 


56% 


Title 1 Status 


Title 1 


35% 


44% 


56% 


60% 


Non-Title 1 


23% 


44% 


39% 


50% 


School Identified for Improvement Status 


Not identified 


26% 


41% 


46% 


53% 


Year 1 and Year 2 of identified for 
improvement status 


56% 


59% 


75% 


78% 


Corrective action status 


48% 


58% 


58% 


61% 


Restructuring status 


63% 


72% 


85% 


83% 


School Poverty Level 


High poverty 


46% 


57% 


70% 


72% 


Medium poverty 


34% 


44% 


55% 


58% 


Low poverty 


19% 


39% 


33% 


46% 


School Minority Concentration 


High minority (75% or more) 


42% 


57% 


72% 


70% 


Moderate minority (25-75%) 


25% 


42% 


44% 


56% 


Low minority (less than 25%) 


29% 


41% 


43% 


50% 


Urbanicity 


Central city 


36% 


48% 


61% 


60% 


Urban fringe/large town 


31% 


45% 


48% 


55% 


Rural/small town 


24% 


39% 


41% 


54% 


Exhibit reads: Twenty-six percent of non-identified schools reported needing technical assistance to 
develop or revise their school improvement plan in 2005—06 or 2006—07, compared with 56 percent of 
schools in Year 1 or Year 2 of being identified for improvement. 


Source: NLS-1VCLB, Principal Survey. 
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